DOCUMENT RESUME 



ED 360 320 



TM 020 117 



TITLE 



INSTITUTION 

REPORT NO 
PUB DATE 
NOTE 
PUB TYPE 

EDRS PRICE 
DESCRIPTORS 



IDENTIFIERS 



Results of the Primary Assessment Program for 1991 iu 
Urban and Non-Urban Schools. Curriculum and 
Assessment Research and Evaluation Report* Report 
2/1992. 

Northern Territory Dept* of Education, Darwin 

(Australia) ♦ 

ISBN-0-72A5-2606-A 

92 

90p. 

Reports - Evaluative/Feasibility (1A2) 
MF01/PC04 Plus Postage. 

''^Academic Achievement; Achievement Gains; Achievement 
Tests; Comparative Testing; Educational Assessment; 
''^Elementary School Students; English; Foreign 
Countries; Grade 5; Grade 7; Intermediate Grades; 
Junior High Schools; Junior High School Students; 
Mathematics Achievement; Rural Schools; Scores; 
Suburban Schools; ^Testing Programs; Test Items; 
'■^Test Results; *Urban Schools 

'"^Australia (Northern Territory); ^Primary Assessment 
Program (Australia) 



ABSTRACT 

This report contains details of the results of the 
Primary Assessment Program conducted in 1991 in urban and non~urban 
schools in the Northern Territory of Australia. The assessment 
program, conducted annually at years 5 and 7 in urban schools and at 
ages 10 years and above in non-urban schools, monitors achievement in 
English and mathematics. In 1991, nearly A, 000 urban students and 
1,700 non-urban students participated in the testing program. 
Findings reveal a significant improvement in the achievement of urban 
students in years 5 and 7 in mathematics in 1991 compared with 1990. 
Fundamental changes in the reading test mace it impossible to compare 
the two years. However, evidence suggests that urban school 
functional literacy and reading comprehension was good, but was not 
as good in the non~"urban schools, where many students appeared unable 
to perform satisfactorily in tasks required for Stages A and 5 of 
reading and Stage A of mathematics. Results are reported in a format 
teachers and principals have found easy to understand. Eleven 
appendixes contain sample questions for the different assessments, 
information about the test committees , and test statistics. 
Information about test items, scores, and mean achievement is 
presented in 26 tables. Score distributions are portrayed in 11 
graphs. (SLD) 
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FOREWORD 



This report contains details of the results of the Primary Assessment Program 
conducted in 1991 in urtjan and non-urban schools*. As can be expected, some 
of the findings are extremely encouraging but others are less so. 

As I write this, I recall the public debate regarding standards when the program 
was launched in urban schools In 1983 and in 1986 In non-urban schools. Even 
before the emphasis on accountability, the PAP had begun evolving its tests to 
accommodate accountability and what was actually taught in the classrooms of 
our schools. As the program evolved, more and more teachers participated In 
the decision-making processes regarding what should be tested and how. The 
tests have improved year by year not only in content but in their format and 
presentation and more recently, in the form that the results are reported to 
schools. We can now confidently say that when schools make good use of the 
program they are finding it to be of very considerable benefit. 

The findings reveal there was significant improvement in the achievement of 
urban students in Years 5 and 7 In mathematics In 1991 compared to that in 

1990. Because of fundamental changes to the reading tests which occurred in 

1991, the report explains that it was not possible to compare reading 
performance In 1 991 with 1 990 but this will be possible in the future. 

Undoubtedly, there Is evidence to suggest that In urt)an schools at Years 5 and 
7, performance In functional literacy and reading comprehension in 1991 was 
good. Students in non-urban schools succeeded on the reading and 
mathematics tasks at Stage 3 but many appeared unable to perform 
satisfaclonly m the tasks required at Stages 4 and 5 for reading and at Stage 4 
for mathematics. ** 

The report goes into considerable detail In describing performance on 
individual tasks. In the statistical data reported to schools, teachers are able to 
evaluate how their students have perfonmed on individual tasks as well as on 
groups of tasks (subtests). This has been a feature of the PAP that teachers 
have found to be of great value. Of equal value are the aggregated results for 
the Terntory which teachers have used as benchmarks to judqe the 
performance of their school cohorts. 

On behalf of the Northern Territory Board of Studies and the Northern Territory 
Department of Education, I wish to take this opportunity to thank everyone who 
has given valuable assistance in making the program a success in the past 
year. I seek your continuing support and cooperation particulariy as we move to 
incorporate in the program the national profiles under development. 



DrCH PAYNE ' 

Chairman 

Northern Territory Board of Studies 




' "Non-uiban schools' in this report refers to schools with predominantly Aboriginal enrolment. 
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EXECUTIVE SUMMARY 



The Primary Assessment Program (PAP), which is conducted annually at 
Years 5 and 7 in urban schools and at ages ten and above in non-urban 
schools, monitors achievement In English and mathematics through 
moderation of school-based assessment of writing and a Territory-wide testing 
program In reading and mathematics. This report provides detailed information 
on students' achievement in the reading and mathematics tests which were 
conducted in botv'i urban and non-urban schools in late 1991. Schools received 
the results for their students and the Territory at the beginning of Term 1 in 
1992. 

The statistical data supplied to schools in Term 1 allows schools to evaluate 
how their students have performed on individual tasks as well as on groups of 
tasks (subtests). The Territory aggregates are used as benchmarks for 
comparison. 

In 1991, nearly 4000 students in Years 5 and 7 In urban schools and 1700 
students aged ten and older in non-urban schools participated in the testing 
program. Although each year has seen a significant increase in the 
participation rate from non-urban schools, this still represents only about fifty 
per cent of the total number in this cohort. 

In the mathematics test, the majority of Year 5 students succeeded in number 
computations but did less well In word problems. Generally, the success rate in 
the space strand was better than in measurement; a high proportion found 
calculation of time intervals, surface area and perimeter especially difficult. 

The majority of Year 7 students were successful in the number tasks such as 
numerical computations, word problems, simple fractions and graphs. But a 
high proportion appeared to have difficulty with aspects of geometry such as 
three-dimensional shapes, translation and rotation. In measurement, students 
did better in tasks involving mass and length than in tasks involving volume, 
time, circumference of a circle and conversion of units. 

Analysis of the mathematics results showed that students in Years 5 and 7 
performed significantly better in 1991 than in 1990. It was not possible to make 
a valid comparison for results in reading as significant changes were made to 
the reading tests in 1991 to bring them into line with the new English 
curriculum. 

Students in non-urban schools sat for the mathematics tests at Stages 3 and 4 
of the Board Approved Curriculum (stages are roughly equivalent to year 
levels). A reasonable proportion succeeded in the basic number tasks but a 
high proportion still had difficulty with subtraction, multiplication and division. 
Measurement proved particulariy difficult for most. Generally, most were able 
to demonstrate a fair understanding of basic ideas in space. 
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In the reading for different purposes tests (functional literacy) for urban 
schools, the materials presented simulated a newspaper. At both Years 5 and 
7. the majority of students succeeded In locating and Interpreting Information, 
following directions and using reference skills. 

Students In Years 5 and 7 scored an average of seventy per cent on the 
reading comprehension tests based on prose passages. In reading 
comprehension, the majority showed that they were able to identify main ideas, 
locate facts and details, recognise cause and effect, make simple inferences 
and give meanings to words or phrases. 

Students in non-urban schools were given a reading for different purposes test 
and a comprehension test made up of three subtests at threo levels, i.e. 
Stages 3, 4 and 5 in the curriculum. Generally, most students found the 
comprehension tests at Stages 4 and 5 very difficult. 

The last two years have seen important developments in test construction and 
reporting of results. A wider range of everyday materials has been included to 
test functional literacy. Students are exposed to texts from two or three genres 
requiring a deeper level of understanding for the comprehension tests. In 
mathematics, the majority of questions involve higher order thinking processes 
such as understanding and application. 

Results are reported In a format which is easier to understand and interpret. At 
inservices held in 1991 and 1992, teachers and principals were more willing to 
engage in frank and open discussions about school results so long as they 
were seen as mutually beneficial. 

For the reader with an interest In measurement statistics, the reliabilities of the 
tests used in 1991 are reported in Appendix XI. The reliability indices for all 
tests were in the region of 0.90. Test writers have reason to feel pleased with 
the high reliabilities obtained. 
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1 INTRODUCTION 



Background 

The Primary Assessment Program (PAP) is a system-wide assessment 
program which monitors achievements In English and mathematics for Years 5 
and 7 students in urt>an schools and students aged ten and over In non-urban 
schools in the Northern Territory. It Is conducted annually by the Northem 
Territory Department of Education Curriculum and Assessment Division under 
the auspices of the Northem Tenitory Board of Studies. 

The PAP originated In 1 982 after the results of NT students in a national testing 
program (Australian Studies In Student Performance Project) triggered a 
vigorous public debate on standards. A broadly based working party Initiated by 
the then Minister for Education established the guidelines for the program. In 
1983 a system-wide testing program on basic skills was Introduced in urban 
schools for Years 5 and 7 and in 1986 the program was extended to non-urban 
schools. 

Prior to 1988, assessment of achievement In urban schools was based on 
minimum competencies (core objectives) for reading and mathematics. Since 
the tests were based on the core objectives and pitched at relatively low levels 
of difficulty with 'passing' scores of 70% con-ect for reading and 80% con-ect for 
mathematics, most urban students 'passed' the tests and did not find them 
challenging enough. Many students and teachers, In fact, did not appear to 
take them seriously. Teachers did not find them particulariy helpful, and except 
for identifying students in the lov/est 20% of the scale, the program appeared to 
serve no useful purpose. It was Inevitable that in order to gain acceptance In 
schools, the test objectives and content had to change. This change was to 
occur both in test content and skills tested, In terms of their range and 
complexity. 

Since 1988, the focus of the PAP in urban schools for Year 7 has shifted from 
assessment of perfonnance on the core objectives to assessment on the whole 
cuniculum and In 1 989 a similar shift was made for Year 5. In the case of non- 
urban schools, the testing program was based on minimum competencies 
expected of students in Year 5 until 1990. In 1991, multilevel tests in both 
reading and mathematics were introduced In non-urisan schools which allowed 
curriculum objectives at lower stages in the curriculum to be incorporated. 
However, students In non-urban schools wishing to attempt the urban schools 
tests were encouraged to do so and a few schools are implementing this. 

The program is oversighted In policy matters by the Primary Assessment 
Committee of the Board of Studies. Changes to the Primary Assessment 
Program are continually being made in response to recommendations from the 
writing panels and suggestions made by principals and teachers at inservice 
activities. The program has won wide acceptance and recognition In NT 
schools In recent years and was endorsed as a project of national significance 
by the then Australasian Co-operative Assessment Program (ACAP), a national 
steering committee sponsored by the Conference of Directors-General. 
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Alms of the Program 



The general aim of the PAP testing program is to monitor student performance 
system wide in some aspects of language and mathematics and to report 
school and system results on the tests. In more specific terms, the aims may 
be summarised as follows: 

• at the classroom level, to provide test results of individual students in 
reading and mathematics to assist learning 

• at the school level, to provide test data which would allow schools to 
compare both individual and group, i.e. school cohort results with the 
Territory aggregates 

• at the system level, to provide test data on achievement in reading 
and mathematics across the Territory and detect trends 

• at both the school and system levels, to give indications of areas of 
strength and weakness in reading and mathematics 

• to provide schools with a bank of high quality assessment materials 
over a period of time. 

The PAP Tests 

The PAP consists of four components: mathematics tests, reading 
comprehension tests, reading for different purposes tests and writing 
moderation exercises. The reading and mathematics tests for urban and non- 
urban schools are administered annually. The tests are constructed by teams 
of experienced teachers and office-based staff. The results of the writing 
moderation exercises carried out annually are not included in this publication 
but are provided in separate publications. 

Writing is assessed in urban and non-urban schools every year by moderation 
of teacher-assessed sample scripts sent in from schools. Schoob .;tre required 
to return samples of students' writing in any one year from two genres, e.g. 
argument and explanation, in accordance with procedures outlined in advance. 
The samples are examined by a team of experienced teachers and office- 
based staff and graded as showing 'high', 'medium' or 'low' competence. The 
results are produced in a booklet which contains a checklist of 'descriptors' for 
assessing quality in key aspects of writing and includes samples of students' 
work showing grades and comments. 
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Tests for non-urban schools are written by teachers and office-based staff with 
experience in teaching in non-urban schools. The test-writing panels put in a 
great deal of time and effort to ensure that the test materials have meaning and 
relevance for Aboriginal students. A lot of attention is given to checking that 
materials are not culture biased as these would put students at a disadvantage. 
Whilst it is recognised that it is not possible to construct a test which is 
absolutely culture free, the tests to be used in non-urban schools need to be as 
culture fair as possible. The use of Aboriginal stories, folklore and reading 
matter familiar to AboKglnal children and the attention given to the choice of 
materials and test construction have resulted in the creation of a distinctive 
testing program for non-urban schools. 

A test specification chart is employed for generating items. The chart at the 
same time provides a check on the number of items constmcted for each of the 
content areas and abilities or skills involved. To give an example, in 
mathematics, approximately half of all questions relate to number and number 
relations and a substantial number of these measure understanding and 
applications of concepts while only a small number test recall. 

Before the tests are finalised, the questions are field-trialled in a sample of 
schools and analysed to improve their quality. Each question is examined for 
relevance to the content area; indices of difficulty, discrimination and reliability 
are calculated using traditional test theory. Some items are discarded without 
any further wortc done on them; many need modification after the review by the 
test writers. The procedures used in the item analysis are designed to ensure 
that the tests are valid in terms of their relevance to both the curriculum content 
and classroom instruction, that they discriminate between able and less able 
students and that they have high reliability. 

All test answer sheets are roturrred to Curriculum and Assessment for 
processing and analysis. Diagnostic information is extracted for use by both the 
school and system to assist student learning. Principals and teachers 
participate in inservices where the PAP tests and results are discussed. 

The test results are reported and returned to schools after the completion of the 
program every year. Each school receives its own students' results and the 
Territory results for comparison. Ail individual and school results are treated 
confidentially and the public report of Territory-wide results does not include 
results of individual students or schools. 

A statistical analysis is carried out to compare system performance year by 
year. This is done by using 'link' items i.e. a sample of common items used 
from one year to the next. 



3 



Three statistical reports are produced for the school and Territory. 
Report 1 : Percentage Correct on Each ttem 

This report shows the percentage of students In the school and Territory 
cohorts answering each question correctly. The Items are ranlted In order of 
difficulty for the Territory cohorts. It allows each school to compare 
performance of its students with that of the Territory Item by Item. The report 
has been found to be partlculariy useful In Identifying the strengths and 
weaknesses of students within a school as well as across the Territory. 

Report 2: Distribution of Test Scores 

This report shows the raw scores and percentages obtained by Individual 
students on each test in a particular school. The distribution of raw scores for 
Territory students Is aJso provided for each of the tests. The report enables a 
student's status (ranking) In relation to the Territory population to be readily 
checked on any test. 

Report 3: Means for Subtests 

In this report, the means and standard deviations for subtests within each 
subject are generated for both the school and Territory cohorts allowing 
comparisons to be made. The report enables the school and the system to 
identify specific areas In the curriculum which may need further attention. 
Furthermore, a statistical test Is carried out to determine If the means for the 
school and Territory are significantly different. 

The school reports have generated a great deal of Interest In recent years. 
Suggestions have come from schools as to how they would like to see the 
results presented. Changes have already been Incorporated for inclusion in 
1992 which should make the results more easily understood and Interpreted. At 
inservice sessions held eariy In 1992, many schools participated In open and 
frank discussions about their own school results within the rules governing the 
confidentiality arrangements. This Is an Indication of the degree of maturity 
which the PAP has attained in recent years and it is a healthy sign. 
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RESULTS OF YEAR 5 MATHEMATICS 



Introduction 

in urban schools, tiie mathematics test for Year 5 was designed to assess 
achievement at Stage 5 of the Board of Studies approved WA Mathematics 
Syllabus. The test comprised sixty Items covering the following strands: space, 
number and measurement, giving a total of sixty mari<s. 

Questions were set In both the open-ended and multiple-choice format. The 
tasks required the recaii of basic facts, computation, understanding of concepts 
and mathematical ideas and applications of concepts. The distribution of Items 
and the relative weighting In the various content areas were determined by the 
test-writing panel with the help of a test specification chart for generating Items. 

The results on Individual Items obtained from the testing program were grouped 
Into three categories of difficulty: easy, moderately difficult and very difficult, 
items answered correctly by less than 40% of students were classified as very 
difficult, between 40% and 70% as moderately difficult and by more than 70% 
of students as easy. 

The distributions of Item difficulties and test scores are Included in this chapter. 
Also Included are the means and standard deviations for the various subtests. 

An analysis of performance on the link Items (common Items) between 1990 
and 1991 was carried out to determine If there was any significant change from 
one year to the next. 

A t-test of significance between means for correlated data was used to test 
whether differences on the link items were significant. This test considered data 
from Individual Items, using proportion correct values, it Is a more sensitive test 
than the usual t-test between means as It uses data from all items. As four 
Items used In 1990 were not Included In 1991 estimates of proportion correct 
were calculated for these. Graph 2.2 Illustrates performance on the link items 
between 1990 and 1991. 

Year 5 Mathematics Results 

The Year 5 mathematics test covered an extensive range of tasks involving 
many of the Important concepts In number, measurement and space expected 
of Year 5 students. Performance was generally satisfactory; the sixty-item test 
had an ovc ^'1 mean of 34.68. 

Certain trei s were evident. Students performed sllghtiy better on Items in the 
space and number strands than In measurement (Table 2.3). 



3 



In the number strand, most students were able to extract information from a 
table (Item 29), Identify even numbers (item 20), perform simple multiplication 
(Items 5, 15 and 19) and addition (items 25, 38) and interpret line and bar 
graphs (Items 45, 53). However, a substantial proportion of students had 
difficulty with division (items 17, 22 and 47), place values (items 4, 37 and 57), 
prime number (item 11) and problems on money (items 3, 17). The majority of 
students were able to add fractions with the same denominator (item 32) but 
quite a high proportion were unable to solve equivalence of fractions (items 16, 
31). 

Students did well in the space strand except for the following areas, i.e. count 
the number of edges of a rectangular prism (item 1), locate coordinates of 
points on a grid (item 6) and follow compass directions (item 51 ). Most students 
appeared to have a good understanding of three-dimensional shapes (item 48), 
symmetry (items 10, 21) and surprisingly, many students were able to work out 
linear transformations such as dilation (item 55) and rotation (item 12). 

Students found several items in measurement difficult. However, the majority of 
students did not appear to have problems in dealing with metric units of mass 
(item 13), volume (items 30, 39, 43, 50 and 54) and distance (items 33, 36 and 
56). Most students were able to measure the perimeter of a polygon (item 18), 
but failed to solve an application problem on the perimeter (item 59). A 
considerable number of students had difficulty with calculation of surface area 
(item 27) and time intervals (item 34). 

Percentage Correct on Items 

A total of 1924 students did the test. As shown in Table 2.1 , only thirteen items 
were In the very difficult category compared to twenty-seven items in the easy 
category and twenty items in the moderately difficult category. Over 90% of 
students answered correctly questions 10, 29, 41 and 48. Most students found 
questions 34, 44 and 59 difficult; less than 20% of the students responded 
correctly to these questions. A sample of ten items across a range of difficulty 
values is included in Appendix II. 



Table 2.1 : Difficulty of ttenis: Mathematics Year 5 



% Answered correctly 


Difficulty 


Number of Items 


70-100% 


Easy 


27 


40 - 69% 


Moderately difficult 


20 


<40% 


Very difficult 


13 


Total 




60 



Distribution of Test Scores 



Table 2.2 shows that 2.86% of students scored 0 - 10 in the sixty-item test, 
while 8.99% gained the top range of 51 to 60. The majority of students scored 
between 31 and 50. it is noted that 64.76% of all students attained scores of 
more than 30 compared with 35.24% of students who scored below 30. It is of 
interest to note that the highest score was 59 (3 students) and no student 
obtained 60/60 and the lowest score was zero (5 students). 



Table 2.2: Distribution of Scores: Mathematics Year 5 



Score Range 


Numtjer of Students 


% Of students 


0-10 


55 


2.86 


11 -20 


216 


11.23 


21 -30 


407 


21.15 


31 -40 


583 


30.30 


41 "50 


490 


25.47 


51-60 


173 


8.99 


Total 


1924 


100.00 



As shown in Graph 2.1. the results of the Year 5 mathematics test seem to 
approach a nomnal distribution, except that it is slightly skewed. A higher 
proportion of students obtained scores greater than the half-way mark. 



Graph 2.1: Distribution of Scores: Mathematics Year 5 
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Means for Subtests 

Although the size of the standard deviations indicates that individual scores 
varied considerably, the mean scores of the subtests were quite similar, i.e. 
means for the subtests were between 50% and 60%. However the mean for 
graphs/statistics fell below 50% of the number of items (Table 2.3). 

1'able 2.3: Means on Subtests: Mathematics Year 5 



Subtest 


Number of Items 


Means 


Standard Deviations 


Number 


14 


8.35 


3.36 


Number relations 


18 


11.02 


3.58 


Measurement 


15 


8.19 


3.22 


Space 


10 


5.83 


2.39 


Graphs/Statistics 


3 


1.30 


0.92 


Total Test 


60 


34.68 


11.95 



More than 50% of questions in number, number relations and space strands 
were found to be in the easy category. It was evident that most students found 
measurement difficult as shown by the majority of items in this strand falling 
into the moderately difficult and very difficult categories (Table 2.4). It is hard to 
make a statement about graphs and statistics as there were only three 
questions in this subtest. 



Table 2.4: Difficulty of Items by Subtests: Mathematics Year 5 







Number of 


Items 




Subtest 


Easy 


1 Moderate 


1 Very Difficult 


Total 


Number 


7 


5 


2 


14 


Number relations 


9 


6 


3 


18 


Measurement 


4 


8 


3 


15 


Space 


6 


1 


3 


10 


Graphs/Statistics 


1 


0 


2 


3 


Total Test 


27 


20 


13 


60 



8 



Comparison 



Table 2.5 shows the results based on proportion conrect for the link Items for 
1990 and 1991. The first four items in the table were dropped in 1991, hence 
figures in brackets for 1991 were estimates of proportion correct for these 
items. A t-test between means for con-elated data on the link items shows a 
significant improvement in performance in 1991 compared with 1990. 



Table 2.5: Comparison Between 1990 and 1991 Performanca: 

Mathematics Yr^r 5 



Item No. (as in 1991) 


Proportion correct 




1990 1 


1991 


Est (1990 qn 6) 


0.42 




Est (1990 qn27) 


0.79 


(0.82) 


Col \i«f«fu ^^Hf^; 


0.49 


(0.51) 


Est (1990 qn56) 


0.25 


^0 7R\ 


33 


0.67 


0.66 


38 


0.66 


0.67 


50 


0.64 


O.SS 


52 


0.56 


0.54 


53 


0.69 


0.75 


55 


0.53 


0.54 


57 


0.38 


0.37 


58 


0.35 


0.40 


59 


0.14 


0.18 


60 


0.77 


0.81 


Mean 


0.52 


0.54 


Std Deviation 


0.20 


0.20 


No. of Students 


1919 


1924 


Correlation 




0.99 


t-vaiue 




3.06 


critical value (df=26) 




2.056 


RO : If |t|>2.056 then reject tfie null hypotheses 


l.e. significant 
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The following graph shows more clearly the performance in 1390 and 1991 on 
each of the link items. Proportion correct figures for most items were higher in 
1991. The con-elation for the link items between the two years was very high 
(r»0.99. Table 2.5). 



Graph 2.2: Comparison on link items: Mathennatics Year 5 
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Item Number (as 1991) 



NB: * indicates tli«se itams w«ra dropped in 1 991 ; the values shown on the graph were 
estimated values. 
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3 RESULTS OF YEAR 7 MATHEMATICS 



Introduction 

In urban schools, the mathematics test for Year 7 was designed to assess 
achievement at Stage 7 of the WA Mathematics Syllabus approved by the 
Board of Studies. The test comprised sixty items covering the following strands: 
space, number and measurement. 

Questions were set in both the open-ended and multiple-choice format. The 
tasks required students to demonstrate recall of basic facts, computation," 
understanding of concepts and mathematical ideas and applications of 
concepts. The distribution of items and relative weighting in the various content 
areas were determined by the test-writing panel with the help of a test 
specification chart for generating items. 

As for Year 5, the results on individual items from the testing program were 
grouped into three catogories of difficulty: easy, moderately difficult and very 
difficult. Items answered correctly by less than 40% of students were classified 
as very difficult, between 40% and 70% as moderately difficult and by more 
than 70% of students as easy. 

The distributions of item difficulties and test scores are included in this chapter. 
Also Included are the means and standard deviations for the various subtests. 

An analysis of performance on the link items (common items) between 1989, 
1990 and 1991 was carried out to detemnine if there were any significant 
changes from one year to the next. 

A t-test between means for correlated data was used to determine whether 
differences on the link Items from one year to the next were significant. This 
test of significance considered data from individual items, using proportion 
correct values. It is a more sensitive test than the t-test between means as it 
uses data from all items. Estimates of proportions correct were made to 
produce comparisons for three items included in 1989 and 1990 but not in 
1991, and three items included in 1990 and 1991 but not in 1989. Graph 2.2 
illustrates performance on the link items between 1990 and 1991. 

Year 7 Mathennatlcs Results 

The Year 7 mathematics test consisted of three strands, namely measurement, 
number and space. Overall performance was satisfactory and the sixty-item 
test had a mean of 32.71 . 
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The majority of students were successful on the tasks in the number strand. 
Most students were able to solve simple word problems (items 3, 23), perform 
arithmetical operations in addition (item 31), multiplication (item 1) and division 
(Items 5, 35), identify prime numbers (item 2), complete a logical sequence 
(Item 29), express a fraction as a percentage (item 4), simplify equivalence of 
fractions (items 7, 56). calculate rates (item 55), and interpret line, pie, bar and 
pictorial graphs (items 14, 25, 44 and 10). However, more than 50% of 
students had difficulty with simplifying improper fractions (items 21, 37), 
rounding (item 6) and applying order of operations (item 38). A high proportion 
of students were able to calculate the average age of four people (item 16) but 
only a few could give the age range (item 17). 

Students found items on space relatively difficult. The majority of students were 
successful in using a metric unit scale (item 50), counting the number of 
possible paths from one point to another (item 59), identifying a scalene 
triangle (item 18) and solving the interior angles of a triangle (item 49). A 
considerable number of students had difficulty with counting the number of 
pairs of congruent triangles in a parallelogram (item 20), locating points in the 
four quadrants (item 57), determining the number of faces, edges and vertices 
of a prism (item 24), identifying planes of symmetry in a rectangular prism (item 
53) and worthing out linear transformations such as dilation (item 39) and 
rotation (item 51). 

In the measurement strand, most students were successful in dealing with 
mass (item 12), perimeter (item 43) and interpreting distance on a map (item 
1 9). items in the vicinity of 50% correct were in the calculation of volume (items 
28, 45), finding time intervals (item 27), finding circumference (item 1 5) and 
area of triangles (items 30, 58), interpreting a flight schedule (item 11), and 
converting metres to centimetres and vice versa (item 13). About a third of tho 
students were able to calculate time intervals in a word problem (item 54) and 
find the area (item 46) and perimeter (item 47) of a composite shape. 

Percentage Correct on Kerns 

A total of 1853 students took the test. As shown in Table 3.1, eleven items 
were located in the easy category, thirty-six items in the moderately difficult 
category and thirteen items in the very difficult category. Students experienced 
least difficulty with questions 3 and 12, with over 85% of students answering 
them correctly. Questions 53 and 48 were the most difficult questions in the 
test with 25.53% and 26.71% of students respectively giving the right answers. 
A sample of ten items across a range of difficulty is included in Appendix III. 



Table 3.1: Difficulty of Kerns: Mathematics Year 7 



% Answered correctly 


Difficulty 


Number of Items 


70-100% 


Easy 


11 


40 - 69% 


Moderately difficult 


36 


< 40 % 


Very difficuK 


13 


Total 




60 
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Distribution of T«st Scores 



Table 3.2 shows that 6.04% of students scored 10 or lower in the sixty-item 
test, while 10.36% of students gained the top range of 51 - 60. The majority of 
students scored between 21 and 50. About 57% of all students attained scores 
more than 30 compared with 43% who scored below 30. It is of interest to note 
that four students obtained the maximum score of 60. 



Table 3.2: Distribution of Scores: lillatlieniatlcs Year 7 



Score Range 


Number of Students 


% of students 


0-10 


112 


6.04 


11 -20 


303 


16.35 


21 -30 


387 


20.89 


31-40 


431 


23.26 


41-50 


428 


23.10 


51-60 


192 


10.36 


Total 


1853 


100.00 



As shown in Graph 3.1, nearly a quarter of the population scored in the ranae 
31 - 40 (23.26%); the majority of students scored in the range 21 - 50 
(67.25%). 

Graph 3.1: Distribution of Scores: IMathematics Year 7 
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Moans fo7 Subtests 



The size of the standard deviations demonstrates that individual scores varied 
considerably. However the means for the subtests were quite similar {Table 
3.3). 

Table 3.3: Meens on Subtests: RAsthematics Year 7 



Subtsst 


Nurnijsr of items 


Means 


Standard Deviations 


fJumber 


14 


8.20 


3.33 


Number relations 


12 


6.38 


2.78 


M^asureTnent 


16 


8.33 


4.21 


Space 


11 


6.50 


3.1S 


Qraphs/StatisticG 


7 


3.31 


1.79 


Total Tejrt 


60 


32.71 


13.74 



For all subtests, most questions were in the moderately difficult cstegcry. 
Students found questions associated with graphs/statistics, measurement and 
number relations slightly harder than questions associated with number and 
space (Table 3.4). 



Table 3.4: DmisuEty of Hems by Subtests: Mathematics Year 7 



1 


Number 


of 






Subtest n 


Easy 1 


Moderate 


j Ver>' Difficult 


Total 


Number 


4 


8 


2 


14 


Number relations 


3 


& 


4 


12 


Measurement 


2 


10 


4 


16 


Space 


2 


8 


1 


11 


Graphs/Statistics 




5 


2 


7 


Total Test 




36 


13 1 


i CO 
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Comparison 



Table 3.5 shows the results on the link items for 1989. 1990 and 1 991 . The first 
three items In the table were dropped in 1991 ; figures in brackets for 1991 were 
estimates of proportion correct for these items; the last three items did not 
appear in 1989; figures In brackets for 1989 were estimates. As shown In the 
table, there was no change in performance t)etween 1989 and 1990 but a t-test 
between means for correlated data shows a significant Improvement in 1991 
compared with performance in 1989 and 1990. 



Table 3.5: Comparison between 1989, 1990 and 1991 Performance: 

Mathematics Year 7 



liem NO. (as in | 




Proportion con'ect 




1 




1 1990 1 


1991 


Pet /1QOA fin tt\ 


U.DO 


O./o 


(0.81) 


Pet /I QOn nnRA\ 

est \i«Rfu qnou) 


Q.U5 


0.06 


/A A^\ 

(0.07) 


Pet /loan nnC:Q\ 


U.4 


0.40 


/A A A\ 

(0.44) 


26 


0 43 




U.*r/ 


27 


0.4 


0.41 


0.46 


28 


o.m 


0.55 


0.56 


41 


0.63 


0.62 


0.63 


42 


0.48 


0.46 


0.52 


43 


0.66 


0.63 


0.73 


49 


0.58 


0.57 


0.57 


55 


0.66 


0.65 


0.68 


56 


0.63 


0.62 


0.64 


13 


(0.42) 


0.41 


0.51 


48 


(0.14) 


0.14 


0.27 


53 


(0.16) 


0.16 


0.26 


Mean 


0.46 


0.46 


0.51 


STD Deviation 


0.20 


0.20 


0.19 


No. of Students 


1797 


1850 


1853 


Corrolation 




0.98 


0.98 


t-value 




0 


4.71 


crHlcai value (dfs28) 




m 


2.05 


RO : If |tj>2.048 then reject the null hypothesis 1.8. significant 
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The following graph compares the performance between 1990 and 1991 on 
each of the link items. It shows remarkably consistent gains in 1991 for the 
majority of link items. 



Graph 3^: Comparison on the Link Items: Mathematics Year 7 



1990 



1 99 1 




6** 50** 59** 13 26 27 28 41 42 43 48 49 53 55 

Item Number (as 1991) 



NB: * indicatos these items were dropped in 1 991 , the values shown on the graph were estimated 
values. 
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4 NON-URBAN SCHOOLS MATHEMATICS TESTS 



Introduction 

The mathematics test for non-urban schools was based on Stages 3 and 4 of 
the Board approved Westem Australia Mathematics Syllabus and was intended 
to measure knowledge and skills related to these stages. It was the first year in 
which the test was set for two stages. The test comprised sixty items covering 
the following strands: space, number and measurement, and each strand 
covered two stages. As in the urban schools testing program, the questions 
were set in both the open-ended and multiple-choice format. It was different 
from the test for urban schools in that there was no time limit for completing the 
test. There was also a practical test but results from the latter are not reported 
here. 

The results on individual items were grouped into three categories of difficulty: 
easy, moderately difficult and very dtlficult. Items answered correctly by less 
than 40% of students were classified as very difficult, between 40% and 70% 
as moderately difficult and by more than 70% as easy. 

The distribution of students in the various score ranges is included in this 
chapter. Also included are the means and standard deviations for the various 
subtests. 

Non-urban Schools Mathematics Results 

The mathematics test which included subtests at two stages, covered basic 
concepts in numt>er, measurement and space. As expected, performanOia on 
the subtest at Stage 3 was better than that at Stage 4. The overall mean was 
26.4 for the sixty-item test. 

In the number strand, most students were able to add without regrouping (item 
48), solve simple word problems (items 8, 15, 18 and 44), interpret a bar graph 
(items 5, 6) and shade in a given fraction (item 7). Students were able to 
identify the smallest integer (item 2), extract information from a table on money 
(item 40) and identify place values (item 4, 47). However, the majority had 
difficulty with subtraction (items 42, 60), addition with regrouping (item 37), 
division (items 10, 32), multiplication (items 28, 33, 45 and 51), identifying 
multiples of 7 from a table (item 22) and chance (item 9). 
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The majority of students did not perform well In measurement. In many areas, 
most students were unsuccessful. Although a considerable number of students 
were able to read digital and twelve-hour clocks (items 26, 36), measure a 
straight line (item 23) and cirde the shape with the longest perimeter (item 3), 
most students could not read a calendar (item 14 and 49), identify the shape 
with the largest area (item 31), draw a rectangle with a given area (item 13), 
give the number of hours in a day (item 12), or calculate how many lots of five 
minutes in half an hour with the aid of a twelve-hour clock face (item 30). Also, 
many students had problems in dealing with metric units (item 17), calculation 
of volume (item 43) and solving word problems such as how many 100 gram 
chocolate bars in 1 kilogram (item 55). 

Generally speaking, most students were able to demonstrate a fair 
understanding of the basic concepts in space, but did not seem to be able to 
use the concepts to solve problems. For instance, many students were able to 
do a simple rotation (item 34) but could not do the rotation on a slightly more 
complicated shape (item 24). Similariy, most students were able to draw an 
object in a given direction (item 19), e.g. east of a stated object, but failed to 
name the correct place north of a health clinic on a given map (item 20). The 
majority of students were able to locate objects in a grid (item 53), complete a 
pattern of shapes (item 1 ) and move from one point to another in a maze (item 
59). Only a minority could identify three-dimensional shapes (item 50), show 
the difference between straight edges and curved edges (item 46), count cubic 
blocks to determine volume (item 38) and demonstrate an understanding of 
symmetry (item 21). 

Percentage Correct on Items 

Altogether 1713 students took the test. As shown in Table 4.1, only four items 
were in the easy category compared to twenty-four items in the very difficult 
category and thirty-two items in the moderately difficult category. Over 75% of 
students answered questions 34 and 59 correctly. Most students found 
questions 10, 17 and 55 difficult with less than 11% of the students responding 
correctly to these questions. A sample of ten items across the categories of 
difficulty is included in Appendix IV. 



Table 4.1 : Difficulty of Items in Mathematics: Non-urban Schools 



% Answered correctly 


Difficulty 


Numtjer of Items j 


70-100% 


Easy 


4 


40 - 69% 


Moderately difficult 


32 


< 40 % 


Very Difficult 


24 


Total 




60 



18 



Distribution of Test Scores 



Table 4.2 shows that 15.18% of students scored 10 or less in the sixty-item 
test, while 3.74% of students obtained scores In the top range of 51 to 60. The 
majority of students scored between 21 and 40. Scores of more than 30 were 
attained by only 41.04% of all students. No student attained the maximum 
score of 60. The highest score was 58 (two students) and the lowest score was 
zero (seventeen students). 

Table 4^: Distribution of Scores in Mathenratics: Non-urban Sctioois 



Score Range 


Number of Students 


% of Students 


0 -10 


260 


15.18 


11 -20 


359 


20.96 


21 -30 


391 


22.83 


31-40 


418 


24.40 


41-50 


221 


12.90 


51-60 


64 


3.74 


Total 


1713 


100.00 



As shown In Graph 4.1 , the scores on this test tend towards the lower values. 
Graph 4.1 : Distribution of Scores in KAatliematics: Non-urban Schoois 
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Means for Subtests 

The size of the standard deviations demonstrates that individual scores varied 
considerably. As expected, the means for Stage 3 items were relatively higher 
than those for Stage 4 items. 



Table 4.3: Means on Subtests in Matheniatics: Non-urban Schools 



Subtest 


Number of Items 


Means 


Standard Deviations 


Measurement Stage 3 


7 


3.38 


1.78 


Measurement Stage 4 


7 


1.62 


1.42 


Number Stage 3 


16 


8.33 


4.60 


Number Stage 4 


18 


7.08 


4.68 


Space Stage 3 


3 


1.97 


0.88 


Space Stage 4 


9 


4.01 


2.19 


Total Test 


60 


26.40 


13.60 



Students appeared to have difficulty in handling the tasks at Stage 4. Stage 3 
items were relatively easier especially items relating to space. Two cut of three 
questions fell in the easy category and none in the very difficult category. 

Table 4.4: Difficulty of Items by Subtests in Mathematics: Non-urban Schools 



Number of Items 


Subtest 


Easy 


1 Moderate | Very 


Difficult 


Total 


Measurement Stage 3 


1 


4 


2 


7 


Measurement Stage 4 


0 


1 


6 


7 


Number Stage 3 


0 


14 


2 


16 


Number Stage 4 


0 


8 


10 


18 


Space Stage 3 


2 


1 


0 


3 


Space Stage 4 


1 


4 


4 


9 


Total Test 


4 


32 


24 


60 
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URBAN YEAR 5 READING TESTS 



Introduction 

Two reading tests were administered to Year 5 students In urban schools: one 
comprehension test and one reading for different purposes test (RDP). The 
tests included questions In both the multiple-choice and open-ended format. 
Students were expected to complete each test within forty-five minutes. 

The comprehension test contained forty Items and the reading for different 
purposes test had thirty-three Items. The prose passages used In the tests to 
measure comprehension were selected from materials which were likely to be 
encouritered in the classroom. The comprehension test required students to 
recognise significant ideas, arrange events In sequence, locate specific details 
and facts, give meaning to words in context, make judgements from given 
facts, draw conclusions, identify character attributes and determine the cause 
of events. 

Reading materials found In dally life (environmental text) were used In the 
reading for different purposes test, for example, a newspaper advertisement or 
a tourist guide. Students were required to locate Information, follow directions, 
use reference skills and Interpret information from a variety of sources. The 
reading materials were presented in the form of a newspaper. 

The comprehension test comprised three subtests: report (PI REP) 
explanation (P2EXP) and narrative (P3NAR). 

The results on Individual Items were grouped Into three categories depending 
on their degree of difficulty: easy, moderately difficult and very difficult. Items 
answered correctly by less than 40% of students were classified as very 
difficult, by more than 70% of students as easy, and by 40% to 70% as 
moderately difficult. 

The distribution of students In the various score ranges on both tests is 
Included In this chapter. 

A table of means and standard deviations for subtests and the total test is 
provided. 

No comparison in performance could be made between results In 1991 and 
those of previous years as materials used eariier were dropped from the testing 
program. The comprehension tests in 1991 had many more Items than any 
comprehension tests administered previously. 

Year 5 Reading Tests Results 

The Year 5 reading tests results were encouraging. The overall means for the 
forty-item comprehension test (UR5C91) and the thirty-three-item reading for 
different purposes test (UR5R91 ) were 26.81 and 24.05 respectively. 

In the reading for different purposes test (RDP), most students had no difficulty 
in answering questions relating to the Territory Wildlife Park (items 1 to 5), 
Microwave Hamburgers Recipe (Items 6 to 12), Darwin Cinema Guide (Items 
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13 to 16), the Darwin Crocodile Farm (Items 17 to 20) and Today's Television 
Guide (Items 31 to 33). There were only two questions in the whole test where 
the majority was unsuccessful, item 21 required students to find the missing 
'guide words' of a dictionary page, while item 29 asked students to choose a 
period of time when the "Golden Moon* take-away restaurant was not operating. 
Perhaps, it could have been a different result if the question had asked for 
hours when the restaurant was operating. 

The comprehension test had three passages which covered report, explanation 
and narrative genres. 

Passage one was an article on the Australian wild dog, the 'DINGO'. Most 
students were able to locate details and facts (Items 1 , 2, 3, 1 3 and 1 5), identify 
the main Idea of a paragraph (items 9, 10 and 11), give the meaning of words 
(item 7), recognise the writer's purpose (Item 8), understand the generic the' 
(item 14), and determine the meanings of words from contextual clues (item 5). 
Although a large number of students were capable of making a simple 
inference on the basis of facts (item 6), about half of all students failed when 
the inference to be made was slightly more complex (item 12). 

Passage two was an explanatory passage which described how human beings 
breathe. The majority of students had no difficulties with locating facts and 
details directly (items 16, 18, 19 and 22), understanding the main idea of the 
text (item 23), recognising implied meanings (Item 26) and determining the 
meanings of words (item 27). However, less than 50% of all students were able 
to interpret and understand details (item 17) or provide a comparison (item 20). 

Passage three was a story about a shepherd boy who cried 'WOLF. Most 
students were able to locate facts and details (items 28. 29 and 30). Identify the 
main idea of a paragraph (item 35), make inferences on the basis of facts 
(items 39. 40). draw a conclusion based on evidence from the text (items 33, 
36) anvi determine the meaning of words from contextual clues (Item 32). 
Slightly more than half of all students were able to recognise the relationship 
between the story and the physical setting (item 38). but only a small proportion 
of students could infer who was telling the story (item 34) or count the number 
of times a particular event appeared in the passage (item 31). (However, there 
was a problem with the question itself in item 34 as there appeared to be more 
than one correct answer.) 

Percentage Correct on Items 

There were 1892 students who sat the reading comprehension test. As shown 
In Table 5.1. only 4 items were in the very difficult category compared to 
twenty-four Items in the easy category and twelve items in the moderately 
difficult category. Over 86% of students answered questions 1, 7. 10 and 28 
correctly. Most students found questions 20. 31 and 34 difficult with less than 
27% of all students responding correctly. Question 31 required students to 
count the number of times a specific event appeared in the passage. A sample 
of items is included in Appendix V. 
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A total of 1 877 students took the reading for different purposes test. About 67% 
(twenty-two Items) of the questions fell In the easy category compared with only 
3% (one Item) In the very difficult category. The most difficult question was Item 
21 which was answered con-ectly by 23.44% of students. Question 21 required 
students to know how to use 'guide words' In the dictionary. Students had least 
difficulty with questions number 8 and 26 In which more than 90% of all 
students got the correct answers. A sample of Items is Included In Appendix VI. 



Table 5.1 : Difficulty of Items: Reading Tests Year 5 



% answered correctly 


Difficulty 


Comprehension 


Different Purposes 






UR5C91 


UR5R91 


70-100% 


Easy 


24 


22 


40 - 69% 


Moderately difficult 


12 


10 


<40% 


Very difficult 


4 


1 


Total 




- 40- 


33 



Distribution of Test Scores 

The results show that In the comprehension test 1 .1 1 % of all students scored 5 
or less compared to 7.14% of all students who scored in the uppermost range 
of 36 - 40. There were 80.71% of students who achieved more than 20 out of 
40. Although the majority of students performed very well in the test, no student 
obtained full marks. The highest score was 39 (six students) and the lowest 
score was zero (eight students). 

The reading for different purposes test comprised thirty-three Items. A score of 
five or less was achieved by 1.39% of students, while 13.64% of students 
scored the top range of 31 - 33. Most students scored between 26 - 30. The 
highest score was 33 (twenty-five students) and the lowest score was zero 
(eight students). 



Table 5.2: Distribution of Scores: Reading Year 5 



COMPREHENSION (UR5C91) 


FUNCTIONAL PURPOSES (UR5R91) 


Score 


No. of 


%0f 


Score 


No. of 


%of 


Range 


Students 


Students 


Ranqe 


Students 


students 


0- 5 


21 


1.11 


0- 5 


26 


1.39 


6-10 


56 


2.96 


6-10 


71 


3.78 


11-15 


94 


4.97 


11-15 


123 


6.55 


IS -20 


194 


10.25 


16-20 


233 


12.68 


21-25 


303 


16.01 


21-25 


453 


24.13 


26-30 


506 


26.74 


26-30 


710 


37.83 


31-35 


583 


30.81 


31 -33 


256 


13.64 


36-40 


135 


7.14 








Total 


1892 


100.00 


Total 


1877 


100.00 
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As shown in Graph 5.1. the distribution of the results is highly skewed, 
suggesting that most students found the test relatively easy. 



Graph 5.1: Distribution of Scores: Compreiiension Year 5 
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As Shown in Graph 5.2, the distribution of the results for the reading for 
different purposes test is similar to that for the comprehension test. From the 
two graphs, Graph 5.1 and 5.2, it is clear that most Year 5 students did well in 
the two reading tests. 

Graph 5.2: Distribution of Scores: RDP Year 5 
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Means for Reading Tests 



The size of the standard deviations once again demonstrates that individual 
scores varied considerably for both the comprehension (UR5C91) and reading 
for different purposes (UR5R91) tests. The mean scores for both tests were 
encouraging. 



Table 5.3: Means on Reading Tests: Year 5 



TEST CODE 


No. of Items 


MEANS 


STDDEV 


No. of students 


UR5C91 


40 


26.81 


7.52 


1892 


UR5R91 


33 


24.05 


6.67 


1877 



As shown in Table 5.4, the means expressed as percentages of the number of 
items corresponding to report (P1REP), explanation (P2EXP) and narrative 
(P3NAR) were 75.86%. 59.83% and 63.38% respectively. The table also 
indicates that students performed better on questions on the report than on the 
other genres. 



Table 5.4: Means on Subtests: Comprehension Year 5 



TEST (UR5C91) 


No. of Items 


MEANS 


STDDEV 


No. Of students 


REPORT (PI REP) 


15 


11.38 


3.02 


1892 


EXPLANATION (P2EXP) 


12 


7.18 


2.84 


1892 


NARRATIVE (P3NAR) 


13 


8.24 


2.74 


1892 


TOTAL 


40 


26.81 


7.52 


1892 
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6 URBAN YEAR 7 READING TESTS 



Introduction 

One comprehension test and one reading for different purposes test (RDP) 
were set for Year 7 students in urban schools. The tests included questions in 
both the multiple-choice and open-ended formats. Students were expected to 
complete each test within forty-five minutes. 

The comprehension test contained thirty-nine items and the reading for 
different purposes test had thirty-five items. Their readability levels had been 
trial tested and carefully considered by the panel of teachers who developed 
the tests. 

The comprehension test comprised three subtests, narrative (P1NAR), 
explanation 1 (P2EXP) and explanation 2 (P3EXP). The prose passages used 
in the test to measure comprehension were selected from materials normally 
encountered in the classroom. The comprehension test required students to 
recognise significant ideas, arrange events in sequence, locate specific details 
and facts, give meanings of words in context, make judgements from given 
facts, draw conclusions, identify character attributes and determine the cause 
of events. 

Reading material found in daily living was used in the reading for different 
purposes test; for example, a newspaper advertisement or a tourist guide. 
Students were required to locate information, follow directions, use reference 
skills and interpret information from a variety of sources. The stimulus material 
was presented in the form of a newspaper. 

The results on individual items were grouped into three categories depending 
on th^ degree of difficulty: easy, moderately difficult and very difficult. Items 
answered correctly by less than 40% of students were classified as very 
difficult, by more than 70% of students as easy, and by 40% to 70% as 
moderately difficult. 

The distribution of performance tor varicus score ranges on both tests is 
included in this chapter. 

A table of means and standard deviations for the subtests and the total test is 
provided. 

The comprehension tests contained many more items than any comprehension 
tests administered prior to 1991. As the materials used in previous years were 
dropped, no comparison of performance can be made between that of 1991 
and those of eartier years. 

Year 7 Reading Tests Results 

The 1991 results from urtsan schools showed that the majority of students had 
acquired the reading skills expected of Year 7 based on the NT curriculum. The 
thirty-nine-item comprehension test (UR7C91) had an overall mean of 26.95, 
while the thirty-five-item reading for different purposes test (UR7R91) had an 
overall mean of 26.81 . 
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Item 19 was the only question in the reading for different purposes (RDP) test 
answered correctly by less than 50% of all students. The question required 
students to find the missing 'guide words' on a dictionary page. It Is interesting 
to note that most Year 5 students also had difficulty in finding the missing 
'guide words' on a dictionary page. Most students had little problem in locating 
Information, following directions, using library reference skills or Interpreting 
information from material presented. 

The comprehension test comprised a narrative and two explanatory passages. 

Passage one was an extract from a narrative text called 'Horned Helmet' in 
Reading from the Bookshelf, A high proportion of students showed evidence of 
ability in identifying character types and sensing emotional reactions (items 7, 
8), making simple Inferences (Items 1, 10), determining meanings of words 
from contextual clues (items 2, 5 and 6), identifying emotional effects produced 
by a text (item 13), predicting an outcome and drawing a conclusion (item 3), 
recognising the author's point of view (item 12), drawing a conclusion based on 
evidence from the text (item 4), interpreting and understanding detail by 
'reading' pictures and graphics (item 15) and determining the main idea of a 
text (item 9). Slightly more than half of all students were able to form sensory 
impressions from the language of the text (item 11) and identify implied 
meaning from the language (item 14), while marginally less than 50% of all 
students wore capable of understanding the schematic structure of the 
narrative. 

Passage two was an explanatory passage describing the greenhouse effect. 
Only a minority of students had difficulty with locating facts and details (Items 
17, 19, 20, 21 and 24), recognising cause-effect relationships (items 22, 27), 
drawing a conclusion based on evidence from the text (item 28), interpreting 
and understanding details by reading pictures/graphics (item 18) and 
recognising a sequence of occurrences (item 26). More than half of all students 
were able to find the relationship between two different diagrams (item 25) and 
recognise the function of the atmosphere from the text (item 23). All questions 
from thiS passage were answered correctly by more than 50% of all students. 

Passage three explained how volcanoes are formed. Only a few students had 
difficulty with locating facts and details (items 29, 30, 31 and 33), 
understanding terminology (items 34, 36 and 39), recognising cause-effect 
relationships (items 32, 35) and interpreting and understanding details by 
'reading' pictures and graphics (item 37). Item 38 was the only question where 
less than a quarter of all students had answered correctly. This question 
required students to extract information from a diagram showing an explosive 
volcano. 



Percentage Correct on Items 

Altogether, 1842 students took the comprehension test. As shown in Table 6.1 , 
only one item was in the very difficult category compared to twenty items in the 
easy category and eighteen items In the moderately difficult category. Over 
86% of students answered questions 8, 10, 17 and 30 correctly. Questions 38 
and 16 were the only two items in which less than 50% of students responded 
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correctly. Question 38 was an open-ended question requiring students to locate 
spodfic details and facts. A sample of items is include^i in Appendix VII. 

A total of 1845 students took the RDP test. It was noted tliat 82.85% (twenty- 
nine Items) of questions fell in the easy category and none were found to be in 
the very difficult category. The most difficult question was number 19 with 
48.02% of students answering correctly. Question 19 required students to Icnow 
how to use 'guide words' in the dictionary. The easiest items were numbers 2 
and 27 for which more than 95% of students responded con-ectly. A sample of 
items is inctuded in Appendix VIII. 



Table 6.1: Difficulty of nems: Reading Year 7 



% Answered correctly 


Difficulty 


Comprehension 


Different Purposes 






UR7C91 


UR7R31 


70-100% 


Easy 


20 


29 


40 - 69% 


Moderately difftcutt 


18 


6 


<40% 


Very difficuH 


1 


0 


i Total 




39 


35 



Distribution of Test Scores 



There were 0.60% of students scoring 5 or less, while 9.32% of students 
scored in the topmost range of 36-39 in the comprehension test. About 60% of 
students attained more than 20 out of 39. The highest score was 39 (four 
students) and the lowest score was zero (throe students). 

The RDP test comprised thirty-five i1ems. Only 0.49% of students scored 5 or 
less, while 50.89% of students scored in the uppermost range of 31-35. Less 
than 1 0% of students scored lower than 21 out of 35. The highest score was 35 
(114 students) and the lowest score was zero (three students). 



Table 6.2: Distribution of Ssores: Reading Year 7 



COMPREHENSION {UR7C91) 


DIFFERENT PURPOSES (UR7R91) 


Score 


No. of 


%0f 


Score 


No. of 


%0f 


Range 


Students 


Students 


Range 


Students 


Students 


0- 5 


11 


0.60 


0- 5 


9 


0.49 


6-10 


40 


2.17 


6-10 


33 


1.79 


11 -15 


122 


6.62 


11 -15 


44 


2.38 


16-20 


202 


10.97 


16-20 


82 


4.44 


21 -25 


296 


16.07 


21 -25 


203 


11.00 


26-30 


452 


24.54 


26-30 


535 


29.00 


31-35 


546 


29.64 


31 -35 


939 


50.89 


36-39 


173 


9.39 








Tola! 


1842 


100,00 


Totai 


1845 


100.00 
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As shown in Graph 6.1 , the distribution of the results was skewed towards the 
higher scores, suggesting cleariy that students did reasonably well in the 
comprehension test. 

Graph 6.1: Distribution of Scores: Comprehension Year 7 
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As shown in Graph 6.2, the distribution of the results for the RDP test is far 
from a bell shaped normal distribution. The results v/ere very encouraging. 



Graph 6.2: Distribution of Sii^res: RDP Year 7 
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Moans tor Receding Tests 



The size of the standard deviations once again demonstrates that individual 
scores varied considerably for both the comprehension and the functional 
purposes (RDP) tests. The mean for the functional purposes test was notably 
higher than that for the comprehension test. 



Table 6.3: Means on Reading Tests: Year 7 



TEST CODE 


No. Of items 


MEANS 


STD DEV 


No. Of students 


UR7C91 


39 


26.95 


7.45 


1842 


UR7R91 


35 


28.81 


5.99 


1645 



As shown in Table 6.4, the means expressed as percentages for narrative 
(P1NAR), explanation 1 {P2EXP) and explanation 2 (P3EXP) were 70.75%, 
71 .66% and 63.9%, respectively. It appears that the subtest on passage 3, 
explanation 2, was marginally more difficult. 



Table 6.4: Means on Subtest: Comprehension Year 7 



TEST(UR7C91) 


No. Of Items 


MEANS 


STD DEV 


No. of Students 


NARRATIVE (PI NAR) 


16 


11.32 


3.17 


1892 


EXPLANATION 1 (P2EXP) 


12 


8.60 


2.67 


1892 


EXPLANATION 2 (P3EXP) 


11 


7.03 


2.65 


1892 


Totai 


39 


26.95 


7.45 


1892 
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7 NOi^-URBAN SCHOOLS READING TESTS 



Introduction 

Two tests were set for non-urban schools; a comprehension test and a reading 
for different purposes test. As in urt)an schools, the tests included questions in 
both the multiple-choice and open-ended formats. Time allowed for the 
completion of the test was left to the discretion of the teacher. The testing 
program was to be completed over a fixed period of a few days. 

The comprehension test contained sixty-five items and the reading for different 
purposes test consisted of fifty-three items. 

The prose passages used in the comprehension test were selected from 
materials normally encountered in the dassroom. The test required students to 
recognise significant ideas, arrange events in sequence, locate specific details 
and facts, give meaning to words in context, make judgemants from given 
facts, draw conclusions, identify character attributes and dotermine the cause 
of events. 

A selection of reading materials found in daily living was used in the reading for 
different purposes test, for example, a newspaper advertisement for a tourist 
destination. Students were required to locate infomiation, follow directions, use 
library reference skills and interpret information from a variety of sources. 

The comprehension test comprised three stages and each stage consisted of 
two subtests: Stage 3 included a letter (PI S3) and a simole narrative (P2S3), 
Stage 4 included a procedure (P3S4) and an explanation (P4S4) and Stage 5 
included a report (P5S5) and a nan-ative (P6S5). 

The results on individual items were grouped into three categories depending 
on the degree of difficulty: easy, moderatelj;' difficult and very difficult. Items 
answered correctly by less than 40% of students were classified as very 
difficult, by more than 70% of students as easy, and by 40% to 70% as 
moderately difficult. 

The distribution of performance of students for various score ranges on both 
tests is included in this chapter. 

A table of means and standard deviations for subtests and total test is 
provided. 
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N&ri-urban Scho&l Reading Tests Results 

The results show that non-urban students found the reading comprehension 
(ABC91) and reading for different purposes (ABR91) tests difficult. The means 
for the slxty-five-item comprehension test and the fifty-three-item reading for 
different purposes (RDP) tesn were 24.82 and 26.09 respectively. 

In the RDP test, slightly more than half of all students were able to locate 
details and facts from a page of contents (items 1 - 4). A similar proportion of 
students answered correctly questions relating to a map of the Northern 
Territory (items 5-9) except item 6 in which students were asked to name the 
ranges near Alice Springs. From the Blekbala Mujik band poster, around 60% 
of all students were correct on items associated with locating details (items 1 0, 
12 and 13), but more than half of all students had problems in locating 
information, when the word Tirst' or 'after* was included in the question (items 
11, 14). From the food and drink poster, 65% - 70% of students were able to 
find out the cost of the goods (items 15, 18), which item to buy for washing 
(item 19) and the name of the shop from the poster (item 17), but less than half 
of ai! students were able to locate the information regarding the weight of 
coffee (item 16). Only about one-third of all students were successful on 
questions about the use of a telephone directory (items 20 - 24) which 
probably suggests that many were unfamiliar with the task. Around 50% of all 
students were able to locate information from the 'Frontier Camel Farm' 
advertisement (items 25 - 30), but only 22% were able to interpret the 
information provided (item 28). Slightly more than half of all students were 
capable of locating facts (items 31, 33 and 34), but less than half could 
detemiine the order of instructions (items 32, 35) from the 'A24 Lice Remover 
Shampoo' directions. From the 'Excursion Timetable', approximately 50% of all 
students were able to state the day a given activity was held or vice versa 
(items 36, 37, 38, 41 and 42), but most students failed to locate information 
given outside the table (item 40). Neariy 50% of all students were able to 
answer questions relating to the "TV Guide' (items 43 - 47). Approximately half 
of all students were able to match the correct word to a picture (items 48 - 53). 

The comprehension test comprised Stages 3, 4 and 5. Each stage had two 
passages. The first two, middle two and the last two passages belonged to 
Stages 3, 4 and 5 respectively, it should be noted that the higher the stage, the 
more difficult the items in the test. 

Passage one (Stage 3) was a letter. More than half of all students were able to 
identify the purpose of the letter (item 8) and give the date on which the letter 
was written (item 7). Slightly less than half were able to identify the sender and 
receiver (items 1 , 2), locate details from the contents (items 3, 5 and 6) and find 
out the cost of the stamps (item 5), but only a quarter of the students could 
interpret and predict the next event based on the contextual clues (item 9). 

Passage two (Stage 3) was a simple nan^ative called The big old crocodile'. 
Most students had no difficulty in identifying the main character (item 10). 
Approximately 50% of all students were able to locate details and facts (items 
1 1 , 1 2, 1 3, 1 4, 1 6, 1 7, 1 8 and 1 9) and identify the main idea of the whole story 
(item 15). 



ERIC 



32 



Passage three (Stage 4) described a procedure in making a 'damper*. About 
50% of students were able to locate details and facts (items 23, 21 and 26) and 
arrange the sequence of events (item 24). but only about 30% were able to 
make simple inferences (items 22. 25. 28 and 29). 

Passage four (Stage 4) was an explanation called. 'Getting pandanus ready for 
use'. This passage consisted of eleven questions. Only one question (item 30) 
on locating facts from text was answered con-ectly by more than 50% of all 
students. The majority of students experienced difficulty in identifying the 
author (item 39). identifying the main idea in a paragraph and in the whole story 
(items 38. 40), and in locating facts and details (items 31. 32. 33. 34. 35. 36 
and 37). 

Passage five (Stage 5) was a report on lead poisoning, 'Magpie geese cause 
concern'. Approximately one third of all students were able to locate facts 
(items 41, 42, 44, 45, 46 and 48). About one quarter of students were able to 
identify the main idea of the report (item 50), interpret and make simple 
inferences (item 49) and locate details (items 43, 47). Only one-seventh of all 
students were able to identify the main kjea of a paragraph (item 51). 

Passage six (Stage 5) was a narrative about a snake, 'Perriwanteena'. All items 
had a success rate of well below 50%. About 30% to 40% of students could 
find facts and details (itenis 52, 54, 55, 56, 57, 59 and 60). Between 25% and 
30% of students were able to make simple inferences (items 61 , 63), identify 
main characters (item 65) and suggest a meaningful title (item 62). The tasks of 
arranging events in a sequence proved difficult for a large majority (item 64). 



Percentage Correct on ttems 

A total of 1330 students took the reading comprehension test. The distribution 
of items was found to be as follows: easy, one item; moderately difficult, 
twenty-six items, and very difficult, thirty-eight items (Table 7.1). Students 
found questions 35, 51 and 64 difficult with less than 20% of all students 
responding correctly. Question 51 required students to recognise the main idea 
of a paragraph. Questions 10 and 17 were the only two questions in which 
more than 60% of all students answered correctly. 
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The number of students who sat for the RDP test was 1 424. As shown in Table 
7.1, no Item fell in the easy category: there were forty-three items which were 
moderately difficult and ten items tumed out to be very difficult. Most students 
had difficulty with questions 28 and 35; less than 30% of all students answered 
them correctly. Question 28 required students to locate information from an 
advertisement and apparently more logical thinking was needed in answering 
this question. The easy questions were numbers 10, 15 and 19, which were 
responded to con'ectly by more than 66% of all students. 



Table 7.1: Difficulty of Items in Reading: Non-urban Schools 



% Answered 


Difficulty 


Comprehension 


Different Purposes 


Correctly 




ABCgi 


ABR91 


70-100% 


Easy 


1 


0 


40 - 69% 


Moderately difficult 


28 


43 


<40% 


Very difficult 


38 


10 


Total 




65 


53 



Distribution of Test Scores 



In the reading comprehension test which had sixty-five items, 31.73% of all 
students scored 10 or lower, while 2.33% of all students attained the 
uppermost score range of 61 - 65. The top score in this test was 65 (five 
students) and the bottom score was zero (1 36 students). 

The RDP test comprised fifty-three items. Some 26.12% of students scored 10 
or lower, whilst 4.42% of students scored in the uppermost range of 51 - 53. 
The maximum score of 53 was obtained by eleven students; however, sixty-five 
students scored zero. 



Table 7.2: Distribution of Scores In Reading: Non-urban Schools 



COMPREHENSION (ABC91) 


DIFFERENT PURPOSES (ABR91) 


Score 


No. of 


%0f 


Score 


No. of 


%0f 


Ranqe 


students 


Students 


Ranqe 


students 


students 


0-10 


422 


31.73 


0-10 


372 


26.12 


11 - 20 


217 


16.32 


11 - 20 


230 


16.15 


21 - 30 


173 


13.01 


21 - 30 


179 


12.57 


31 - 40 


179 


13.46 


31 - 40 


248 


17.42 


41 - 50 


153 


11.50 


41 - 50 


332 


23.31 


51-60 


155 


11.65 


51 - 53 


63 


4.42 


61-65 


31 


2.33 








Total 


1330 


100.00 


Total 


1424 


100.00 
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The graph in Graph 7.1 shows that the higher the score range, the smaller the 
proportion of students. Evidently, most students found the test difficult. 



Graph 7.1: Distribution of Scores in Comprehension: Non-urban Schoois 
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The distribution of scores depicted in Graph 7.2 shows two peaks: about 26% 
of students were in the 0 - 10 range and 23% in the upper range of 41 - 50. 
There appear to be two distributions and one could only conjecture as to the 
reasons for this. There is evidence to suggest that there was a substantial 
proportion of reasonably good performers but also a large number of very low 
achievers. 

Graph 7.2: Distribution of Scores in RDP: Non-urban Schools 
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Means for Reading Tests 



The mean score for the comprehension test was lower than that for the RDP 
test. The size of the standard deviations demonstrates again that individual 
scores varied greatly for both tests. 

Table 7.3: Means on English Tests: Non-urban Schools 



TESTCODE 


No. Of Items 


MEANS 


STDDEV 


No. of Students 


ABC91 


65 


24.82 


1951 


1330 


ABR91 


53 


26.09 


16.74 


1424 



Table 7.4 shows that the means were quite evenly distributed among the 
subtests. They appear to be low i:^ all subtests. As expected, students 
performed better on the subtests at the lower stages. The size of the standard 
deviations indicates that individual scores varied a great deal. 



Table 7.4: Means on Subtests In Comprehension: Non-urban Schools 



TEST(ABC91) 


No. of items 


MEANS 


STD DEV 


No. Of 
^nudents 


Letter (PI S3) 


9 


4.08 


2.99 


1330 


S.Narrative (P2S3) 


11 


5.95 


4.29 


1330 


Procedure (P3S4) 


9 


3.66 


3.16 


1330 


Explanation (P4S4) 


11 


3.63 


3.44 


1330 


Report (P5S5) 


11 


3.13 


3.41 


1330 


Narrative (P6S5) 


14 


4.36 


4.83 


1330 


Total 


65 


24.82 


19.51 


1330 
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8 SUMMARY AND CONCLUSION 



i'iiLT"!^®'' ^0°° students in Years 5 and 7 from all urban 

""fSl!?^ participated in ?he Pntar? 
assessment Program (PAP). Another 1700 students aged ten and older from 

«n;^'^^"*^^°c°i?.P^'*'^P^^«^ ^ s^fTiilar PAP testinrprtwram There we^^ 

XstuSS?h« h^'"'1 y^^'^ older cShSudinS 
400 Students fr^om the homeland centres. The PAP is conducted annually as a 
rnonrtonng device for standards across the Territory and a me^fof rei^^ 
m^them^'cs'''"' ''"'^ "'"'^"^^ ^" °^ ^""^^ do^^TEngfrs^h^'ang 



In some aspects, the PAP is different from other programs of its kind in 
Australia. Since its introduction in 1983 in urban schools thi confider^Sali S 
?eSSywlll."''°'"^'' andfhe systlm h~^^^^ 

It may be argued that one of the reasons why the PAP has wnn u/Mo 
^""""i P''"<="»'« ^^^'^ is iScLTthe resSte have been 
cr.ri.f-.. . "lentioning. In March this year, at an Inseivice held in Alica 

SSi? 

mservices in the future so long as it is seen as mutually beneficial. 

The last two years have seen Important developments in the areaQ nf tact 

l^iS^r ■ ^ ""^J ""^f ^™ consistent with the learning outcomes In the new 

mSefate Keen"lnr^*d'S*?i f T?? ^ ^n^releVdaT 

nidienais nas oeen inciuded to test literal comprehension and in mariinn 

'°H ■ ^'^'^^d ^° texts trbr^Tle^^wo ge^^ 

engaged at a deeper level of understanding than previously ° 

In rnathematics there has been an increasing tendency to include more 

SSnS rnt''f?"'^'^'"^"9 P^°^«^«^- the foSr ca egories o1 
sKiiis tes^^ed— recall, computation, understanding and application— the maioritJ 
of questions were in the understanding and appSion cmeaorSs An 
overwhelming number of items appeared in the open-^^^^^^^ 
prLete?"' ^^^^tions were indud^ed to test hS order 



Tht cTJT -7 °^ the results in the mathematics tests for urban schools follows 
The sixty-Item mathematics test for Year 5 covered an extensive range of asks 
ZHn^'' '^e^^^'-e'^ent and space. With a mean scx)rrof IS^obta nfd 
perforn^ance was generally considered to be satisfactory. The maioritJ of 
students were successful in interpreting gid^jhs. adding and sSSino 
S^uf "h •'^"^"'^'"a ^^^^ numbSrs. However. iudenlS^did not peS 
!S ^nn"^ problems; and they were less successful in dealing with pTaS 
values and equivalence of fractions. In the space strand, most stLdems were 
able to recognise shapes and lines of symmetry and succeeded n trantlatfno 
and rotating shapes but many had difficulty in handlinTcoord inates In Ke 
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rortaeifln niane It was in the measurement strand that students had least 
su^S /S hSSgh ml^^^^ a problem with tasks involymg metnc 

unSfSmTs lenj^^^^^^ a high proportl^D" f^^ c^culation of time 

irttervals. surface area, and perimeter espeaally difficult. 

A mean of 33 obtained for the sixty-Item test in Year 7 Is comparable to that for 
YeTs In the Ser strand, the majority could operate with integers 
decimals framiSn^ and word problems. They were less success ul in 
Sing m?rLper f^^io^s. order of operations and app«)ximat.onJn the 
sMKand m^ were able to identify types of triangles and calculate angles 
KifeThigh^^p^)^^^^ failed to recdgniS congruent triangles, translate and 
?o^a?e1^^elorW^^^ number of faces. «lges and ve«^^^^^^^ Ser and 
mftasurament strand, most were successful in finding mass, penmeier ana 
on a m^ Items in the vicinity of 50% correct were in calculation o 
Sotfm^Se internals, circumference, area of tjamg^^. mterpreting^a^^^^^^ 
schedule and converting metres to centimetres. About a third of the students 
were able to find the area and perimeter of a composite shape. 

An analvsis of performance in mathematics was carried out to determine if 
fher^we^e any sta^^^^ changes between the results in 1990 and those m 
199? fof Yel^Mnd 7 respectiSely. A test of significance between means fo 
correlated data showed a significant improvement m performance in 1991 at 
each year level. This was indeed very encouraging. 

Whereas for urban schools, the mathematics test covered one stage at each 
vea? e?ll i e Sage 5 for Year 5 and Stage 7 for Year 7. the test for non-urban 
scS en^mpassed two stages. Stages 3 and 4 of the Jiathema u^^^ 
curriculum. In the number strand, most were able to add without regrouping 
solve word problems, read a bar graph and shade a given fraction. They could 
iSe sSi^lelt^iXer. read a table and identify, place, valye^ 
majority could not perform arithmetical operations involving regrouping. Tasks 
Sihe measuremem strand proved difficult for most Although a cons de^^^^^^ 
nurnber could read a digital and a twelve-hour dock, measure a straight line 
and Wentify the shape with the longest perimeter, most were unable to read a 
^Srendar. identify thTlargest area, calculate how '^.^"V °i 
half an hour or how many 100 gram chocolate bars in 1 kilogram. In the space 
stVand many we?e able t^^ rotate an object, locate objects in a grid or complete 
fpatttn o?sh^es but only a minority iould identify three-dimensional shapes, 
find volume by counting cubes or recognise a symmetncal shape. 

The mathematics test for non-urban schools had changed ^nsid^^^^^^^^^ 
structure and content in 1991 ; hence it was not possible to compare the results 
between 1990 and 1991. 

The results from the Year 5 reading tests in "^^f^^^Io^f JrS^?^^^^^^ 
mean for the thirty-three-item reading for different purposes (RDP) test was ^4 
and the mean for the forty-item comprehension test was ^7. 

The stimulus materials for the RDP test were presented in the form of a 

;Swspaper. Most students had no trouble in responding to i^^^ 

various kinds of environmental print such as the Territory Wildlife Park 

CrooDdile Farm pamphlet and Today's Television Guide. 
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The comprehension test included three passages from the report, explanation 
and narrative genres. Analysis of the results gave mean scores of 76%, 60% 
and 63% respectively. Passage one was an article on the Australian wild dog. 
the dingo. Most students were able to locate details and facts, identify the main 
idea of a paragraph, give meanings of words and recognise the writer's 
purpose. Of two tasl<s which required students to infer from the text, one was 
answered correctly by 74% but the other had a success rate of only 43%. 

Passage two was an extract explaining how human beings breathe. The 
majori^ could locate facts and details, identify the main idea of the text and 
give meanings of words. But less than 50% couid compare between two 
structures. 

Passage three was the well-known story about a shepherd boy who cried, 
"Wolf. Most students succeeded in locating facts and details, identifying the 
main ideas, inferring and drawing conclusions and giving meanings of words. 

Results from the Year 7 reading tests in urban schools gave a mean of 27 on 
the thirty-nine-item comprehension test and a mean of 29 on the thirty-five-item 
reading for different purposes (RDP) test. These were very satisfactory results. 

In the RDP test which simulated a newspaper, a variety of everyday materials 
was presented including information about Ross River Fever, Museums of the 
Northern Territory, Yulara Tourist Resort, a cake recipe, a product label from a 
chemist, and a page from a telephone directory and a dictionary. The majority 
succeeded in locating or interpreting information, following directions and using 
library reference skills. 

The reading comprehension test included a narrative and two explanatory 
texts. Average scores obtained were 71%, 72% and 64% respectively. The 
results were very satisfactory. 

Passage one was a nan-ative. The majority showed that they were able to 
identity the characters, make simple inferences, give meanings of words, 
predict an outcome, recognise the author's point of view and identify main 
ideas. 

Passage two was an explanatory text which described the greenhouse effect. 
Most succeeded in locating facts and details, recognising cause and effect, 
drawing a conclusion and stating a sequence of occurrences. 

Passage three explained how volcanoes were formed. Most students could 
locate facts and details, interpret terminology used, identify cause and effect 
relationships and interpret information from pictures and graphics. 

In non-urban schools, the results in the reading tests indicated that the 
students found them to be quite hard. Means for the RDP test (fifty-three items) 
and comprehension test (sixty-five items) were 26 and 25 respectively. 

In the RDP test, a little more than 50% were able to locate facts and details 
from a page of contents, a simple map of the Northern Territory and a poster 
about a music band. Students were more successful in locating infomiation 
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from a food and drink poster, but less successful In using a telephone directory. 
In the advertisement for the Frontier Camel Farm, about 50% could locate the 
Infomiatlon required but a much lower proportion could Interpret the facts. In 
most of the other tasks, the success rates were about 30-60%. 

The comprehension test for non-urban schools contained passages at three 
levels of difficulty: Stages 3, 4 and 5 of the curriculum. An analysis was carried 
out for each of the stages. 

At Stage 3, the text was a short, simple letter. More than 50% could identify the 
purpose of the letter and give the date on which it was written. Slightly less 
than 50% were able to identify the sender and receiver, locate details and find 
the cost of the stamps but only a quarter could interpret and predict the next 
event. Also, for this stage, a simple narrative called The big old crocodile' was 
given. The majority had no trouble in identifying the main character and about 
half were able to locate facts and details and identify the main idea of the story. 

The two passages at Stage 4 consisted of a procedural and an explanatory 
text. In the first, about making a damper, many had difficulty in sequencing 
events and making Inferences. In the second, the majority were unable to 
identify the author, select the main idea and locate facts and details. 

At Stage 5. the first text was a report on lead poisoning, 'Magpie geese cause 
concern'. About one-third could locate facts, a quarter were able to identify the 
main idea of the report, infer and locate details. The second passage was a 
narrative about a snake. The success rate was well below 50% for all items. 
Between 30% and 40% could locate facts, and about 30% were able to identify 
the main characters and suggest a meaningful title. Putting events in a 
sequence proved difficult for a large majority. 

Significant changes to the reading tests were necessitated in 1991 to bring 
them in line with the new English curriculum. As a consequence of this, no 
comparison was possible between performance in 1990 and 1991. The tests 
designed for 1992 will provide a basis for comparing 1992 results with those 
obtained in 1991. 

For the reader with an interest in measurement statistics, some information 
about the characteristics of the tests used in the PAP in 1991 is given in 
Appendix XI. The test writers will have reason to feel pleased with the 
reliabilities obtained for all the tests in 1991 which were in the region of 0.9 or a 
little higher. It should be mentioned that due to the large variation in scores 
coming from a very heterogeneous cohort aged ten and older in non-urtDan 
schools, the reliabilities obtained for the non-urt)an tests were marginally 
inflated. 



APPENDIX 1: 



1991 COMMITTEES FOR THE PRIMARY 
ASSESSMENT PROGRAM 



NT BOARD OF STUDIES - Primary Assessment Committee 



Mr Cliff Fowler 
Mr Ron Abbott 
Mr Nick Cockshutt 
Mr Huang Zheng Sen 
Mr Mick Myers 
Ms Sue Murphy 
Ms Robyn Ferguson 
Ms Judy Payne 
Ms Pascale Dixon 



(Chair) Chief Assessor- ERA 
Principal - Millner Primary School 
Director- Curriculum 
Principal Research Officer - ERA 
Principal - Moil Primary School 
(Executive Officer) SEO - ERA 
Shepherdson College 
Ludmilla Primary School 
(Executive Officer from 1 Jan 1992) 
SEO-ERA 



TEST CONSTRUCTION PANELS 

Urban Schools Year 5 Mathematics Test Panel 



Ms Sue Murphy (Convenor) 

Ms Pascale Dixon 

Ms Robyn Blake 

Ms Colleen Wiiiiams 

Mr David Henry 

Mr Neil Wiiiiams 

Ms Liz Gammon 

Mr John Moulds 

Ms Pam Adams 

Ms Anne Mauger 



Curriculum & Assessment 
Curriculum and Assessment 
Wanguri Primary School 
Sanderson Primary School 
Nakara Primary School 
Howard Springs Primary School 
Jingili Primary School 
Ludmilla Primary School 
Ludmilla Primary School 
Moil Primary School 



Urban School ^ Year 7 Mathematics Test Panel 



Mr Albert Loh (Convenor) 

Mr Alan Sarg&m 

Ms June Wessels 

Mr Loveii De'Souza 

Mr Bill Armstrong 

Ms Josie Roberts 

Mr Geoff Giiiman 

Mr Gerry McCormack 

Mr Peter McPhee 

Ms Sue Rae 

Mr Bill Shorter 



Curriculum & Assessment 
Wanguri Primary School 
Sanderson Primary School 
Nakara Primary School 
Ludmilla Primary School 
Moil Primary School 
Holy Spirit Primary School 
St John's College 
Wagaman Primary School 
Parap Primary School 
DanAfin High School 
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Non-urban Schools Mathematics Test Panel 



Ms Sue Murphy (Ccnvenor) 

Ms Pascals Dixon 

Mr Sarry Kepert 

Ms Jan Perrin 

Mr Paul Bubb 

Ms Diana Michaiek 

Ms Nellie Mok 

W Peter AUery 

Mr Bill Turner 



Curriculum & Assessment 
Curriculum & Assessment 
Schools North Branch 
Schools Noith Branch 
Curriculum & Assessment 
Belyuen School 
AEPDEB 
AEPDEB 

Moil Primary School 



Urban Schools Yr 5 and Yr 7 Reading for Different Purposes Tests Panel 



Ms Jieannie Abbott (Convenor) 

Ms Debbie Ford 

Ms Julie Wiilis 

Ms Denise Cole 

Ms Georgia Barker 

Ms Vivienne Hayward 

Mr Rick Coliester 

Mr Chris Pownall 

Ms Anne Scott 

Ms Karen Taylor 



Curriculum & Assessment 
Sanderson Primary School 
Sanderson Primary School 
Parap Primary School 
Millner Primary School 
Curriculum & Assessment 
Howard Springs Primary School 
Jingili Primary School 
Ludmilla Primary School 
Ludmilla Primary School 



Urban Schools Yr 5 and Yr 7 Reading Comprehension Tests Panel 

These tests were constructed by Ms Jeannie Abbott and Ms Pascaie Dixon 
with assistance from specialists within the Department. 



Non-urban Schools Reading for Different Purposes Test Panel 



Ms Pascaie Dixon (Convenor) 

Ms Karen McCarthy 

Mr Sean Ryan 

Mr Barry Kepert 

Ms Margaret Osborne 

Ms Pam Norman 



Curriculum & Assessment 
Rapid Creek Primary School 
Gray Primary School 
Schools North Branch 
Schools North Branch 
Operations North 



Non-urban Schools Reading Comprehension Test Panel 

Ms Pascaie Dixon (Convenor) Curriculum and Assessment 

This test was constructed at regional inservices during the year. The primary 
purpose of the regional inservices was to explain the Primary Assessment 
Program (PAP) to schools within the region. 
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URBAN SCHOOLS WRHING MODERATION PANEL 



Ms Jeannle Abbott (Convenor) 

Ms Debbie Ford 

Ms Chris Khan 

Mr Geoffrey Nalder 

Ms Jackie Thompson 

Ms Rita McGregor 

Ms Freda Spann 

Ms VIvlenne Jennings 

Ms VIvlenne Hayward 

Ms Usa Bacskai 



Curriculum & Assessment 
Sanderson Primary School 
Malak Primary School 
Leanyer Primary School 
St Paul's Primary School 
Wanguri Primary School 
Wanguri Primary School 
Moulden Pari< Primary School 
Curriculum & Assessment 
Jingili Primary School 



NON-URBAN SCHOOLS WRITING MODERATION PANEL 



Ms Pascale Dixon (Convenor) 

Ms Sandy Tyndall 

Ms Veronica Untern 

Ms Kaye Byrne 

Ms Elaine Lawurrpa 

Ms Mares Mathews 

Ms Rebecca Baker 

Ms Nicole Purceli 

Ms Mona Rennie 

Ms Terry Davidson 

Ms Belinda Baker 

Ms Cecil Nielsen 

Ms Sue Murphy 



Curriculum & Assessment 
Alice Springs Regional Office 
Baridy Regional Office 
Shepherdson College 
Shepherdson College 
Maningrida School 
Maningrida School 
Elliott School 
Elliott School 
L£(jamanu School 
L£tjamanu School 
PEO TESL 

Curriculum & Assessment 
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APPENDIX II: YEAR 5 MATHEMATICS SAMPLE QUESTIONS 



1 . How many edges does a rectangular prism have? 




Strand: Space 



Answer 
% Correct = 48.0% 



12. Complete the pattern by filling the blank square. 



Strand: Space 



% Correct = 70.5% 



16. 



8 



Strand: Number 



% Correct = 30.4% 



1 7. 4 people share the cost of a $1 5.00 pizza equally. How much do they 
pay each for their share? 



Strand: Number 



Answer : $_ 
% Correct = 30.7% 
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22. 



6 612 



Answer 



Strand: Number 



27. 



% Correct s 46.6% 



What is the surface area of the cube? 



Strand: Measurement 



Answer : ^squares 

% Correct s 29.3% 



32. 



10 10 



strand: Number 



% Correct = 81 .6% 
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34. There are several stops on the journey between Danwin and Alice 
Springs. 

iUS TIMETABLE 



DARWIN to ALICE SPRINGS 

Departs Daily Time Service 15 B 



Dep. 


1100 


DARWIN 69 Mitchell St 


Arr. 


1430 


Katherlne Roadhouse 


Dep. 


1500 


Katherine Roadhouse 


Arr. 


2030 


Elliott Roadhouse 


Dep. 


2100 


Elliott Roadhouse 


Arr. 


0610 


AUCE SPRINGS Plaza Hartley St 



For how long did the bus stop altogether? 

Answer : 



Strand : Measurement % Correct = 1 9.8% 



36. Which is the longest distance? 

A. 1 km B. 2 km 

C. 1 300 metres D. 1 400 metres 

Strand : Measurenwnt % Correct = 77.3% 



43. 



^ 1L(1000mL) 250mL 
TIN CUP 
How many cups of water will I need to fill the tin? 



Strand: Measurement 



Answer : cups 

% Correct = 69.7% 
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APPENDIX 111: YEAR 7 MATHEMATICS SAMPLE QUESTIONS 



Kim walked 500 m north, 400 m east and then 300 m south. How far 
has Kim walked? 



Strand: Number 

g is equivalent to 



Answer: 



% Correct = 90.5 



m 



15 



^- 20 



B. 



D. 



3 
8 

9_ 
15 



Strand: Number % Correct = 75.5% 

1 2. The mass of the small cube is 50 g. Find the mass of the rod 



50 g 



Strand: Measurement 



21. Simplify 4| + | 



z: 



Answer: 



% Correct = 87.3% 



Answer: 



g 



Strand: Number 



% Correct = 49.7% 
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A man starts work in the morning at 



and has lunch at 




How long is it from when he starts work to when he has his lunch? 

Answer : h min 

Strand: Measurement % Correct = 45.6% 

Find the area of the shaded triangle. 



7m 

































i \ 















10 m 

Answer: _ 

Strand: Measurement % Correct = 45.2% 




46. Find the area of the lawn. 




10m 



Answer: 

Strand: Measurement % Correct = 28.3% 



50. The distance between Tennant Creek and Alice Springs is about 
500 km by road. On a map with a scale of 1 cm representing 
200 km, the distance between these two towns is 

Answer; cm 

Strand: Space % Correct = 71 .2% 



54. A Year 7 student ran 8 laps of the oval at an average time of 

1 minute 30 seconds per lap. If the student started at 8.21 am, what time 
did the student finish? 

Answer; am 

Strand: Space % Correct = 35.8% 
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57. Plot the following co-ordinates (4, 5), (0, 1 ), (-5, -2) and (-3, 5). 

A 











5 


I 




j 

i 










' — 4 






1 










3 


• 

; 
1 




i 












1 
I 




1 










1 

0 


X 




\ 




A 


O 
O 




1 




1 




3 4 5 




























-2 


















^ -3 


















— -4 

c. 











Strand: Space % Correct = 28.7% 
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APPENDIX IV: NON-URBAN SCHOOLS MATHEMATICS 
SAMPLE QUESTIONS 

3. Circle the shape with the longest perimeter. 









1 


1 1 1 
i 1 1 




1 1 1 








A. 


1 « 1 1- . 

1 1 1 


B. 

















T T 

J L 



I L 



D. 



Strand: Measurement(Stage 4) 



%Correct = 55.8% 



8. If you bought boots which cost $32 and shorts which cost $1 2, 
how much would you spend? 



Answer:$_ 



strand: Number(Stage 4) 



%Correct = 54.3% 



17. One kilogram equals 



strand: Measurement(Stage 4) 



grams. 

%Correct = l1.0% 
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22. Shade the squares which show multiples of 7. 



1 


2 


3 


4 


5 


6 


7 


8 


9 


10 


11 


12 


13 


14 


16 


16 


17 


13 


1d 


20 


^1 




23 


24 


25 


26 


27 


23 


2^ 


30 


31 


32 


33 


34 


35 


36 


37 


38 


3d 


40 



Strand: Number(Stage 4) %Correct = 26.6% 

26. The time shown on the clock is: 



A. one thirty 

B. ten thirty 

C. ten o'clock 

D. quarter past ten 

Strand: Measurement(Stage 3) %Correct = 67.4% 
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30, How many lots of five minutes in half an hour? 




Answer: 

strand : Measurement(Stage 3) %Correct = 1 9.0% 
34. Complete the pattern and draw the missing clown's head. 




\ ® ^ 




strand: Space(Stage 3) 



%Correct s 80.8% 



ERIC 



54 



g: 



37. 



23 
476 
+ 13 



Strand: Number(Stage 4) %Correct = 33.1 % 

38. How many small cubes will fit inside this window? 



////// 

/ 



Strand: Space(Stage 4) 

















/ 
/ 
/ 


window 




/ / / / 















Answer: 



%Correct = 20.7% 
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53. The Buliock is at 



A5. Where is the Crocodile? 















4 












3 




t ^ ••••• . 




■A 




2 












1 














A 


B 


c 


D 


E 



(S4:F1:1 A3m) 



Answer: 

Strand: Space(Stage 4) %Correct = 55.3% 
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APPENDIX V: 



YEAR 5 READING COMPREHENSION 
SAMPLE QUESTIONS 



THE BOY WHO CRIED 'WOLF 



Once there was a shepherd boy who had to 
go every day to a lonely pasture to tend his 
father's sheep. The pasture was at the foot of 
a Tiountaln near a dark forest, and the boy 
found the days long and dreary. He longed for 
companions to help pass the lonely hours. 



One day the shepherd boy had an idea about 
how he might amuse himself. Rushing down 
towards the village, he cried out, "Wolfl Wolfl' 

The villagers, thinking that the sheep were 
being attacked, grabbed up their clubs and 
pitchforks and hurried to the pasture to help 
the boy beat off the wolf. But there was no 
wolf there, and the villagers retumed home. 



This diversion so pleased the shepherd boy 
that he decided to repeat his perfomiance. 
Twice more he rushed from the pasture crying 
'Wolf I Wolf!' and twice more the villagers came 
to his aid. 



Then one day a real wolf did attack the sheep, 
and the frightened shepherd boy raced to the 
village calling 'Wolf! Wolf!'. But the villagers 
went on with their work, paying no attention to 
him, and the wolf devoured many of his sheep. 
Too late, the shepherd boy learned that - liars 
are not believed even when they tell the truth. 




This fable is believed to have been written by Aesop, a slave who lived in 
Greece many hundreds of years ago. 
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28. 



How often did the boy tend his father's sheep? 



A. Once a week 

B. Every day 

C. Whan his father asked him 

D. When the villagers were busy 

PER CENT CORRECT = 88.05% 

29. The boy did not enjoy his day because 

A. it was long and dreary. 

B. he was frightened of the wolf. 
0. the villagers ignored him. 

D. he did not like sheep. 

PER CENT CORRECT = 77.64% 

30. Why did the boy cry 'Wolf! Wolf 1' the first time? 

A. He wanted to amuse himself. 

B. He saw a wolf. 

C. The sheep were being attacked. 

D. It had been a long day. 



PER CENT CORRECT = 85.47% 

32. In paragraph 4, the word diversion means 

A. effort. 

B. cry. 

C. turn. 

D. amusement. 

PER CENT CORRECT = 61.68% 

33. Why did the villagers pay no attention to the boy when he really cried 
for help? 



Ans. 



PER CENT CORRECT = 76.22% 
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Choose the most suitable title for paragraph 5. 



A. 
B. 
C. 
D. 



Real Wolf Attacks 
Villagers To The Rescue 
Shepherd Boy Runs 
Villagers Attack Wolf 



PER CENT CORRECT = 78.70% 



The moral of this story is that 

A. sheep must be well protected against wolves. 

B. shepherd boys have important jobs. 

C. liars are not believed even when they teli the truth. 

D. village people are hard workers. 



How do you think the boy felt when there was a real wolf but no one 
believed him? 

A. He did not care. 

B. He was frustrated. 

C. He was sad. 

D. He felt unlucky. 



This story is set mainly 

A. at the foot of a mountain. 

B. in a dark forest. 

C. at the top of a mountain. 

D. inside a village. 



Next time the shepherd boy will not 

A. look after the sheep. 

B. feel sad and lonely. 

C. help the villagers. 

D. cry for help unnecessarily. 



PER CENT CORRECT = 76.48% 



PER CENT CORRECT = 37.42% 



PER CENT CORRECT = 51.06% 



PER CENT CORRECT = 78.17% 
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APPENDIX VI: YEAR 5 READING FOR DIFFERENT 
PURPOSES SAMPLE QUESTIONS 



TERRiTORY WILDLIFE PARK ADVERTISEMEhfT 



GO WILD ON 
AUSTRALIA 

DAY! 




You are invited to 
celebrate Australia 
Day with some of its most unique, 
furry, feathered and fishy citizens 
who inhabit the Territory Wildlife Park. 



During your visit you can 
enjoy Aussie meat pies 
and lamingtons at the kiosk. 

The park is open daily 
from 9.00 a.m. to 4.00 p.m. 

Telephone 88 6000 for 
further information. 



Territory Wildlife Park 
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1 . The park is open from 9 am - 4 pm 



A. at weekends. 

B. on weekdays. 

C. every day. 

D. on school holidays. 

PER CENT CORRECT = 87.96% 

2. How many groups of wildlife inhabit the Park? 

A. Two 

B. Three 

C. Four 

D. Six 

PER CENT CORRECT = 62.07% 

3. What special Australian foods can you buy at the kiosk? 
Ans. 

Ans, 

PER CENT CORRECT = 83.80% 

4. Who are the 'citizens' in the wildlife park? 

A. Northern Territory people 

B. Park rangers 

0. . Tourists from other places 
D. Birds, animals and reptiles 

PER CENT CORRECT = 73.63% 

5. Which special day is mentioned in this advertisement? 
Ans. 

PER CENT CORRECT = 74.11% 
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CROCODILE FARM ADVERTISEMENT 




DARWIN 

CROCODILE 
FARM 

40 KILOMETRE 
STUART HIGHWAY 

OPEN 7 DAYS A WEEK 
9am - 5pm 

PHONE 38 1450 

FEEDING 
7 DAYS A WEEK 

TWICE ON SUNDAY 
FEEDIl'G SESSION & TOUR 
2Pri DAILY 
GUIDED TOUR 
1 lAM DAILY 
EXTRA FEEDING SESSION 
1 1 AM SUNDAY 

Genuine Farm Raised Crocodile 
Products Available 

Admission: S7.50 Adults 
J3.00 Children 
S5. 00 Pensioners 
V 



7. If you visited the crocodile fami on a Sunday, you could see the 
crocodiles being fed 

A. once. 

B. twice. 

0. three times. 
D. seven times. 

PER CEMT CORRECT = 87.85% 
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1 8. The farm is open between 

A. 9 am - 2 pm. 

B. 1 1 am - 2 pm. 

C. 9 am - 5 pm. 

D. 5 am - 9 am. 

PER CENT CORRECT = 83.27% 

1 9. Feeding time at tlie Crocodile Farm is at 

A. 2 pm daily. 

B. 5 pm daily. 
0. 9 am daily. 
D. 11 am daily. 

PER CENT CORRECT = 79.49% 

20. What do you understand by 'genuine farm raised crocodile products'? 

A. Things made from crocodiles bred in the rivers. 

B. Things made from crocodiles bred at the farm. 

C. Copies of crocodile products. 

D. Toy baby crocodiles. 

PER CENT CORRECT = 58.34% 
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APPENDIX VII: YEAR 7 READING COMPREHENSION 
SAMPLE QUESTIONS 



PASSAGE THREE 

HOW ARE VOLCANOES FORMED ? 

In May 1990, a huge volcanic eruption blew away the top 400 metres of Mount 
St Helens in the United States. Dust, ash and gas rose high in the sky, and 
towns up to 500 kilometres downwind were covered in gritty volcanic ash. A 
large crater was left in the top of the mountain. 

The rock in the Earth's mantle is like a thick paste, or the inside of a partly 
cooked cake. It is very hot, and in parts it is molten. This thick, hot, molten 
rock is called magma. It also contains dissolved gases. The enormous 
pressure from the surrounding rocks keeps the magma fairly solid. Sometimes 
this pressure forces the magma through a weaker part of the Earth's crust. 
When this happens, a volcano forms. 

One way of understanding how magma is squeezed out at the surface of the 
Earth, is to think of what happens when a can of soft drink is shaken. Pressure 
builds up as long as a thumb is held over the opening, but if the thumb is lifted, 
the pressure is released. This causes an eruption. 

When the magma reaches the surface, it erupts from a vent . Sometime*^ it 
oozes out steadily. Other times it blasts out with incredible force, as it dia at 
Mount St Helens. 

After a volcano has erupted and the pressure has been released, the magma 
may harden to form a plug which blocks the vent. When this happens, the 
eruption stops, and it is said that the volcano is dormant, or sleeping. Mount 
St Helens is one of these. If it does not empt again, it is said that it is extinct 
or dead. On the other hand, if the pressure underneath the volcano builds up, 
it may become active again. 




Figure 1 When a tube of tcx)thpaste has not been us»d for a while, a hard lump forms in the mouth of the 
tube. The tube has to be squeezed very hard until the pressure forces it out. This is similar to a dormant 

PLEASE TURN OVER 
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What happens when volcanoes erupt ? 



When magma reaches the Earth's surface it is called lava. It is usually about lOOOooC, 
and is red-hot As it cools, the lava turns to solid loclc This may take weeks, or it may 
happen very quickly if the lava flows into waten 

Some volcanoes erupt violently, throwing dust, ash, rock, steam and other gases high 
into the air. Lava is usually produced firom time to time rs well* A steep-sided 
volcanic cone is built up, with a crater at the top (Figure 2). Mount St Helens is this 
type of volcano. 




Flgur* 2 Explosiva volcanoes form stMp, oorw-shaped mountains. 



Other volcanoes empt quiedy, with the lava spreading out to form a flat, shield-shaped 
volcano- The volcanoes on the Hawaiian islands are like this. Sometimes the lava is 
thin and runny. At other tinaes it is thick and lunq)y, like porridge, and hardly flows at 
all. 

Volcanoes also produce gases, arid many of these arc poisonous. When lava contains a 
lot of gas, it may froth violentiy. When this lava cools, the rock that forms is full of 
holes where the gas bubbles used to be. 




Figuro 3 Quiot volcanoM fom flat, shtold-sh«p«d mountains. 

There are about 500 active volcanoes around the world There arc no active volcanoes 
in Australia, but there are many extinct ones: for example. Mount Warning in New 
South Wales and Mount Gambler in South AustraUa. 

i4d£^p/«d from; Stannard, Patar and Williamson, Kan. 1990. Sdtonoa Wow; Boofc f,Macmlllan, 
Malbourna. 
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29. Magma is 



A. moHen rock. 

B. molten lava 

C. hot ash. 

D. poisonous gas. 

PER CENT CORRECT = 79.26% 



32. How is magma forced through the Earth's crust ? 

A. Pressure from surrounding rocks 

B. Pressure from a solid plug 
0. Magma becoming too hot 
D. Too much gas building up 

PER CENT CORRECT = 58.74% 



33. A volcano is formed when 



A. lava reaches 1 0OO'^C. 

B. magma escapes through the Earth's crust. 

C. pressure builds up in the Earth. 

D. steam escapes from cracks in the Earth. 

PER CENT CORRECT = 65.53% 



34. What is meant by a "dormant" volcano ? 



A. One that will never erupt again 

B. One that has never erupted 

0. A volcano like those in Australia 

D. A volcano that can awaken at any time 



PER CENT CORRECT = 68.57% 



35. Magma becomes lava 

A. when it cools to form rock. 

B. when it is under the Earth's crust. 
0. when it reaches the Earth's surface. 
D. when it becomes hot ash. 

PER CENT CORRECT = 67.75% 
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36. A volcano is extinct when it 

A. stops erupting for many years. 

B. never empts again. 

C. builds up pressure inside. 

D. forms into a flat shield-shaped mountain. 

PER CENT CORRECT s 67.43% 

37. Look at Figure 1 . The hard lump of toothpaste that forms in the tube acts 
the same way as 

A. a plug in the vent of a volcano. 

B. magma oozing from a volcano. 
0. a violently erupting volcano. 

D. pressure from gases in a volcano. 

PER CENT CORRECT = 63.90% 



39. At present. Mount St Helens is 

A. a quiet volcano. 

B. an exploding volcano. 

C. an extinct volcano. 

D. a sleeping volcano. 

PER CENT CORRECT = 61.07% 
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APPENDIX Vlll: 



YEAR 7 READING FOR DIFFERENT 
PURPOSES SAMPLE QUESTIONS 



Alrpor 



47 3 km 
!40 km 




Sunset Strtp 13 km 
Ayers Rock 16 k 
Tht Q\Qts 23 km 

1. SHEHATON AYHHS ROCK HOTEL 

2. FOUR SEASONS YULARA RESORT 
1 AYERS ROCK LODGE 

4. AYERS ROCK CAMPGROUND 

5. VISITORS DISPLAY AND INFORMATION CENTRE 

6. THEATRETTE AND AMPHITHEATRE 

-IN VISITORS CENTRE. Venue for sWe shows 
arxl part? rangers' talks. Pane Rangers on Guty. 
Open 9am to 7pm 

7. YULARA'S COMMUNITY SQUARE 

Hall, creche, chiloren's and catooor auditonum. 
The aimuiance statbn. mcdkal and dental 
suites are adjacent to this area. 



8. SHOPPING rACILrnSS 

Incluae a suoermarxet. toor agency, last film 
processing. AN2 BanK. newsagency/souvenir/ 
post office, and a miik car and iast-food sen/tee. 

9. THE ERNEST GILES TAVERN 
Food Enienainmem Disco 

to. MOBIL YULARA AYERS ROCK 

Soare Parts. Tyre and Meciuncai Repairs 
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1 0. How many lookouts are indicated on the map? 



11, 



13. 



14. 



A. 
B. 
C. 
D. 



3 
4 
5 
6 



PER CENT CORRECT s 60.65% 



If you were standing on Imalung lool<out in which direction would the Yulara 
Community Square be? 



A. 
B. 
C. 
D. 



Northwest 
West 

Southwest 
North 



PER CENT CORRECT = 60.70% 



1 2. Park Rangers are on duty at 



A. 
B. 
C. 
D. 



9 pm. 

6 pm. 

7 am. 
Sam. 



PER CENT CORRECT = 62.11% 

What is the venue for the slide shows and Park Rangers' talks? 

A. Outdoor auditorium 

B. The Ernest Giles Tavern 

C. Theatrette and Amphitheatre 

D. Display and information centre 

PER CENT CORRECT = 81.03% 

How far is it from Yulara Tourist Resort to The Olgas? 
Ans: km 

PER CENT CORRECT = 85.04% 
1 5. To get to Ulum lookout, you have to go 

A. by four wheel drive. 

B. on foot. 

C. on a bus. 

D. by car. 

PER CENT CORRECT = 88.78% 
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1 6. If you take a trip to The Olgas, in what direction must you travel from 
Yulara Tourist Resort? 

A. North 

B. East 

C. South 

D. West 

PER CENT CORRECT = 79.89% 

1 7. Near which number on the map would you find a doctor? 

A. 3 

B. 5 

C. 7 

D. 9 

PER CENT CORRECT = 89.70% 
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APPENDIX IX: NON-URBAN SCHOOLS READING 

COMPREHENSION SAMPLE QUESTIONS 

PASSAGE 5 




Many Aboriginal people wlio regularly eat geese are worried about tlieir 
family's health, since they found out that some magpie geese have been 
poisoned by lead bullets. 

It has been discovered that large numbers of magpie geese in the swamps 
have a sickness from eating the lead shot left by hunters. Many birds that were 
tested had traces of lead in the<r guts. 

The NT Government has now stopped people shooting with lead shot in the 
following places: Howard Springs Hunting Reserve. Harrison Dam. Lambell's 
Lagoon, and Manakai Reserve. Hunters will be forced to change to steel shot if 
they want to hunt on these resen^es. 

Some Aboriginal people have asked the Health Clinic to test their blood so that 
they can find out if they have been affected. Annie Benson, an Aboriginal 
health wort<er, who has been taking Wood samples, has so far found that no 
one has been affected by lead poisoning. 

NT Aboriginal News, Vol.6. No.4 1990 Office of Aboriginal Communications. 

41 . What is the title of the newspaper report? 

A. Magpie geese cause concern 

B. Akioriginal people eat geese 

C. Lead Poisoning in the Temtory 

D. Hunting in the swamps 

PER CENT CORRECT = 37.14% 

42. It has been found that a large number of magpie 
geese have a sickness from 

A. drinking bad water. 

B. eating steel shot. 

C. eating bad food. 

D. eating lead shot. 

PER CENT CORRECT = 35.19% 
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43. Who has left the lead shot in the swamps? 
Ans. 

PER CENT CORRECT s 23.38% 

44. The NT Government has stopped people using 

A. spears. 
D. lead shot. 
0. rifles. 
D. steel shot. 

PER CENT CORRECT = 36.09% 

45. The Aboriginal health worker in the report is ca'led 

A. Harrison. 

B. Marrakai. 

0. Annie Bonson. 

D. Mrs Howard. 

PER CENT CORRECT = 35.79% 

46. Where were traces of lead found in the geese? 

A. In their feathers 

B. In their guts 

C. On their skin 

D. In their blood 

PER CENT CORRECT = 27.89% 

47. Name two places where lead shot is not allowed to be used. 

Ans. 

Ans. 

PER CENT CORRECT = 21.65% 

48. Annie Bonson has found that 

A. many people have lead poisoning. 

B. some people have lead poisoning. 

C. a few people have lead poisoning. 

D. no one has lead poisoning. 

PER CENT CORRECT = 32.33% 
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People are concerned about their family's health because 

A. the geese are all gone. 

C '"'9'^* ^ave lead poisoning 

C. Wood tests are taken. ^^'^""'"S. 

^- babies are getting sick. 

PER CENT CORRECT = 24.14% 

What Is the report mainly about? 

A. The NT Government 

°' Aboriginal health wori<erc 

^- Hunting 

Lead poisoning 

PER CENT CORRECT = 25.11% 
What Is the main !dea of paragraph three? 

^- TaWng Wood samples 

°- Eating geese 

h;- Banning lead shot 

^- Getting sick 

PER CENT CORRECT = 14.59% 
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APPENDIX X: NON-URBAN SCHOOLS READING FOR 

DIFFERENT PURPOSES SAMPLE QUESTIONS 



rUAP OF THE NOfimERN TERJl^XTORl) 



MELVILLE Island 
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What island is closest to Melville Island? 



A. Groote 

B. Elcho 

C. Bathurst 

D. Croker 

PER CENT CORRECT = 64.40% 

6. Name the ranges near Alice Springs. 

A. Simpson 

B. MacDonnell 
0. Ayers Rock 
D. Mt. Olga 

PER CENT CORRECT = 44.73% 

7. How far is it from Tennant Greek to Daly Waters? 

A. 268 km 

B. 349 km 
G. 369 km 
D. 402 km 

PER CENT CORRECT = 61.52% 

8. Name the closest place to Mt. Olga. 

A. MacDonnell Ranges 

B. Simpson Desert 
G. Alice Springs 
D. Ayers Rock 

PER CENT CORRECT = 54.14% 

9. What town is 349 km from Katherine? 

A. Daly Waters 

B. Darwin 

G. Alice Springs 
D. Tennant Greek 

PER CENT CORRECT = 60.25% 
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APPENDIX XI: Test statistics 



Urban Schools Year 5 tests: 



Testcode (Mathematics) : imMA59l 

Number of items 60 

Mean test score 34.68 

Standard deviation 1 1 .95 

KR#20 reliability 0.93 

Standard error of measurement : 3. 1 9 

Number of students 1 924 

Testcode (Comprehension) : UREC591 

Number of Items 40 

Mean test score : 26.8 

Standard deviation 7.51 

KR#20 reliability : 0.89 

Standard eror of measurement : 2.48 

Number of students : 1 892 

Testcode (RDP) URER591 

Number of items : 33 

Mean test score 24 

Standard deviation 6.66 

KR#20 reliability 0.89 

Standard en'or of measurement : 2.17 

Number of students 1 877 



ERIC 



76 



Urban Schools Year 7 tests: 



Testcode (Mathematics) 

Numt)er of items 

Mean test score 

Standard deviation 

KR#20 reliability 

Standard error of measurement 

Number of students 

Testcode (Comprehension) 

Number of items 

Mean test score 

Standard deviation 

KR«20 reliability 

Standard error of measurement 

Number of students 

Testcode (RDP) 

Number of items 

Mean test score 

Standard deviation 

KR#20 reliability 

Standard error of measurement 

Number of students 



URMA791 

60.00 
32.71 
13.74 
0.95 
3.22 
1853 

UREC791 

39 
26.9 
7.45 
0.88 
2.53 
1842 

URER791 

35 
28.8 
5.99 
0.89 
1.92 
1845 
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Non-urban Schools tests: 



Testcode (Mathematics) ABMAX91 

Number of items 60 

Mean test score 26.40 

Standard deviation 13.60 

KR#20 reliability 0.95 

Standard enor of measurement : 3.1 4 

Number of students 1 71 3 

Testcode (Comprehension) ABECX91 

Number of Items 65 

Mean test score 24.8 

Standard deviation : 19.5 

KR#20 reliability 0.97 

Standard error of measurement : 2.94 

Number of students 1 330 

TdStcodd (RDP) ABERX91 

Number of Items 53 

Mean test score 26 

Standard deviation : 16.7 

KR#20 reliability 0.97 

Standard en-or of measurement 2.74 

Number of students 1424 



n 
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